2023-07-13T01:18:48.351 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-13T01:18:48.352 DEBUG:teuthology.run:Teuthology command: teuthology --name gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi --verbose --owner scheduled_gabrioux@teuthology --description orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} --archive /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580 -- /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/orig.config.yaml 2023-07-13T01:18:48.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:18:48.472 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580 branch: cv-refactor-osd-objectstore description: orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} email: gabrioux@redhat.com first_in_suite: false job_id: '7335580' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: cv-refactor-osd-objectstore ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 3990f91ac125621431ef1b77c2fc96421bec9e51 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 3990f91ac125621431ef1b77c2fc96421bec9e51 kernel: hwe: true workunit: branch: cv-refactor-osd-objectstore sha1: 3990f91ac125621431ef1b77c2fc96421bec9e51 owner: scheduled_gabrioux@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 - - host.b - osd.3 - osd.4 - osd.5 - mon.b - mgr.b - client.1 - - host.c - osd.6 - osd.7 - osd.8 - mon.c - mgr.c - client.2 - - host.d - osd.9 - osd.10 - osd.11 - mon.d - mgr.d - client.3 - - host.e - osd.12 - osd.13 - osd.14 - mon.e - mgr.e - client.4 sha1: 3990f91ac125621431ef1b77c2fc96421bec9e51 sleep_before_teardown: 0 suite: orch:cephadm suite_branch: cv-refactor-osd-objectstore suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3990f91ac125621431ef1b77c2fc96421bec9e51 targets: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - cephadm: null - cephadm.shell: host.a: - ceph orch apply mds a - cephfs_test_runner: modules: - tasks.cephadm_cases.test_cli_mon teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-13_00:38:31 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-13T01:18:48.472 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa; will attempt to use it 2023-07-13T01:18:48.473 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks 2023-07-13T01:18:48.473 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-13T01:18:48.475 INFO:teuthology.task.internal:Checking packages... 2023-07-13T01:18:48.505 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3990f91ac125621431ef1b77c2fc96421bec9e51' 2023-07-13T01:18:48.506 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-13T01:18:48.506 INFO:teuthology.packaging:ref: None 2023-07-13T01:18:48.507 INFO:teuthology.packaging:tag: None 2023-07-13T01:18:48.507 INFO:teuthology.packaging:branch: cv-refactor-osd-objectstore 2023-07-13T01:18:48.507 INFO:teuthology.packaging:sha1: 3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:18:48.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=cv-refactor-osd-objectstore 2023-07-13T01:18:49.011 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:18:49.011 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-13T01:18:49.018 INFO:teuthology.task.internal:no buildpackages task found 2023-07-13T01:18:49.019 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-13T01:18:49.039 INFO:teuthology.task.internal:Saving configuration 2023-07-13T01:18:49.051 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-13T01:18:49.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T01:18:49.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.270766', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-13T01:18:49.115 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.277151', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-13T01:18:49.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.274313', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-13T01:18:49.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.272691', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-13T01:18:49.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.275875', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-13T01:18:49.193 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-13T01:18:49.199 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2023-07-13T01:18:49.199 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1'] 2023-07-13T01:18:49.200 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2'] 2023-07-13T01:18:49.200 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3'] 2023-07-13T01:18:49.200 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4'] 2023-07-13T01:18:49.200 INFO:teuthology.run_tasks:Running task console_log... 2023-07-13T01:18:49.400 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ea6961160>, signals=[15]) 2023-07-13T01:18:49.401 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-13T01:18:49.409 INFO:teuthology.task.internal:Opening connections... 2023-07-13T01:18:49.410 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2023-07-13T01:18:49.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:49.468 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-07-13T01:18:49.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:49.532 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2023-07-13T01:18:49.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:49.582 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2023-07-13T01:18:49.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:49.632 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-07-13T01:18:49.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:18:49.684 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-13T01:18:49.697 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-07-13T01:18:49.704 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-07-13T01:18:49.705 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-07-13T01:18:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2023-07-13T01:18:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T01:18:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2023-07-13T01:18:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2023-07-13T01:18:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T01:18:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="20.04" 2023-07-13T01:18:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T01:18:49.754 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T01:18:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T01:18:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T01:18:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=focal 2023-07-13T01:18:49.755 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=focal 2023-07-13T01:18:49.756 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-07-13T01:18:49.783 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-07-13T01:18:49.790 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-07-13T01:18:49.790 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-07-13T01:18:49.796 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="20.04" 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T01:18:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T01:18:49.798 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T01:18:49.798 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T01:18:49.798 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=focal 2023-07-13T01:18:49.798 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=focal 2023-07-13T01:18:49.798 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-07-13T01:18:49.816 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-07-13T01:18:49.823 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-07-13T01:18:49.823 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-07-13T01:18:49.871 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2023-07-13T01:18:49.872 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T01:18:49.872 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2023-07-13T01:18:49.872 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2023-07-13T01:18:49.872 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T01:18:49.872 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="20.04" 2023-07-13T01:18:49.873 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T01:18:49.873 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T01:18:49.873 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T01:18:49.873 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T01:18:49.873 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=focal 2023-07-13T01:18:49.873 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=focal 2023-07-13T01:18:49.874 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-07-13T01:18:49.900 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-07-13T01:18:49.906 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-07-13T01:18:49.907 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-13T01:18:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-07-13T01:18:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T01:18:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-07-13T01:18:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-07-13T01:18:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T01:18:49.913 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2023-07-13T01:18:49.914 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T01:18:49.914 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T01:18:49.914 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T01:18:49.914 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T01:18:49.914 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2023-07-13T01:18:49.914 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2023-07-13T01:18:49.915 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-13T01:18:49.933 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-07-13T01:18:49.940 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-07-13T01:18:49.941 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-13T01:18:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-07-13T01:18:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-13T01:18:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-07-13T01:18:49.947 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-07-13T01:18:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-13T01:18:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="20.04" 2023-07-13T01:18:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-13T01:18:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-13T01:18:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-13T01:18:49.948 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-13T01:18:49.949 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=focal 2023-07-13T01:18:49.949 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=focal 2023-07-13T01:18:49.949 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-13T01:18:49.974 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-13T01:18:49.988 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-13T01:18:50.014 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-13T01:18:50.014 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2023-07-13T01:18:50.018 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-07-13T01:18:50.020 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2023-07-13T01:18:50.023 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2023-07-13T01:18:50.025 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-07-13T01:18:50.031 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-13T01:18:50.050 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-13T01:18:50.051 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2023-07-13T01:18:50.053 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-07-13T01:18:50.069 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2023-07-13T01:18:50.071 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2023-07-13T01:18:50.073 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-07-13T01:18:50.102 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-13T01:18:50.243 INFO:teuthology.run_tasks:Running task kernel... 2023-07-13T01:18:50.267 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-13T01:18:50.268 INFO:teuthology.task.kernel:normalize config orig: {'hwe': True} 2023-07-13T01:18:50.269 DEBUG:teuthology.task.kernel:normalized overrides {'host.a': {'hwe': True}, 'osd.0': {'hwe': True}, 'osd.1': {'hwe': True}, 'osd.2': {'hwe': True}, 'mon.a': {'hwe': True}, 'mgr.a': {'hwe': True}, 'client.0': {'hwe': True}, 'host.b': {'hwe': True}, 'osd.3': {'hwe': True}, 'osd.4': {'hwe': True}, 'osd.5': {'hwe': True}, 'mon.b': {'hwe': True}, 'mgr.b': {'hwe': True}, 'client.1': {'hwe': True}, 'host.c': {'hwe': True}, 'osd.6': {'hwe': True}, 'osd.7': {'hwe': True}, 'osd.8': {'hwe': True}, 'mon.c': {'hwe': True}, 'mgr.c': {'hwe': True}, 'client.2': {'hwe': True}, 'host.d': {'hwe': True}, 'osd.9': {'hwe': True}, 'osd.10': {'hwe': True}, 'osd.11': {'hwe': True}, 'mon.d': {'hwe': True}, 'mgr.d': {'hwe': True}, 'client.3': {'hwe': True}, 'host.e': {'hwe': True}, 'osd.12': {'hwe': True}, 'osd.13': {'hwe': True}, 'osd.14': {'hwe': True}, 'mon.e': {'hwe': True}, 'mgr.e': {'hwe': True}, 'client.4': {'hwe': True}} 2023-07-13T01:18:50.269 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro', 'hwe': True}, 'host.b': {'kdb': True, 'sha1': 'distro', 'hwe': True}, 'host.c': {'kdb': True, 'sha1': 'distro', 'hwe': True}, 'host.d': {'kdb': True, 'sha1': 'distro', 'hwe': True}, 'host.e': {'kdb': True, 'sha1': 'distro', 'hwe': True}}, timeout 300 2023-07-13T01:18:50.270 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T01:18:50.271 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T01:18:50.272 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T01:18:50.272 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T01:18:50.273 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-13T01:18:50.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T01:18:50.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T01:18:50.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T01:18:50.281 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2023-07-13T01:18:50.282 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-07-13T01:18:50.282 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2023-07-13T01:18:50.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T01:18:50.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T01:18:50.284 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-07-13T01:18:50.285 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-07-13T01:18:50.289 INFO:teuthology.orchestra.run.smithi084.stdout:5.4.0-124-generic 2023-07-13T01:18:50.289 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.4.0-124-generic 2023-07-13T01:18:50.289 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2023-07-13T01:18:50.292 INFO:teuthology.orchestra.run.smithi022.stdout:5.4.0-124-generic 2023-07-13T01:18:50.292 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.4.0-124-generic 2023-07-13T01:18:50.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get clean 2023-07-13T01:18:50.327 INFO:teuthology.orchestra.run.smithi103.stdout:5.4.0-124-generic 2023-07-13T01:18:50.328 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.4.0-124-generic 2023-07-13T01:18:50.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get clean 2023-07-13T01:18:50.329 INFO:teuthology.orchestra.run.smithi137.stdout:5.4.0-124-generic 2023-07-13T01:18:50.330 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.4.0-124-generic 2023-07-13T01:18:50.330 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2023-07-13T01:18:50.335 INFO:teuthology.orchestra.run.smithi154.stdout:5.4.0-124-generic 2023-07-13T01:18:50.336 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.4.0-124-generic 2023-07-13T01:18:50.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2023-07-13T01:18:50.426 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2023-07-13T01:18:50.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2023-07-13T01:18:50.435 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2023-07-13T01:18:50.440 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2023-07-13T01:18:50.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2023-07-13T01:18:50.650 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:18:50.653 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:18:50.657 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:18:50.662 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:18:50.667 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:18:50.668 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:18:50.672 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:18:50.683 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:18:50.750 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:18:50.761 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:18:50.769 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:18:50.778 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:18:50.778 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:18:50.783 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:18:50.785 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:18:50.788 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:18:50.840 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:18:50.844 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:18:51.013 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [620 kB] 2023-07-13T01:18:51.074 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:18:51.074 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:18:51.081 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [620 kB] 2023-07-13T01:18:51.215 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,304 kB] 2023-07-13T01:18:51.267 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:18:51.274 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:18:51.286 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:18:51.313 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:18:51.326 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,304 kB] 2023-07-13T01:18:51.347 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,304 kB] 2023-07-13T01:18:51.454 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,304 kB] 2023-07-13T01:18:51.462 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,304 kB] 2023-07-13T01:18:51.495 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:18:51.569 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:18:51.615 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:18:51.626 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:18:51.635 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [366 kB] 2023-07-13T01:18:51.693 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-07-13T01:18:51.694 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [32.0 kB] 2023-07-13T01:18:51.700 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,987 kB] 2023-07-13T01:18:51.713 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [449 kB] 2023-07-13T01:18:51.770 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [449 kB] 2023-07-13T01:18:51.784 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-07-13T01:18:51.784 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,092 kB] 2023-07-13T01:18:51.785 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [366 kB] 2023-07-13T01:18:51.820 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-07-13T01:18:51.821 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,987 kB] 2023-07-13T01:18:51.840 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-07-13T01:18:51.841 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,092 kB] 2023-07-13T01:18:52.001 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:18:52.018 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [277 kB] 2023-07-13T01:18:52.026 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:18:52.057 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [33.3 kB] 2023-07-13T01:18:52.059 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [291 kB] 2023-07-13T01:18:52.070 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.070 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [855 kB] 2023-07-13T01:18:52.095 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.159 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [32.0 kB] 2023-07-13T01:18:52.162 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [277 kB] 2023-07-13T01:18:52.172 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [33.3 kB] 2023-07-13T01:18:52.179 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [291 kB] 2023-07-13T01:18:52.210 INFO:teuthology.orchestra.run.smithi022.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.211 INFO:teuthology.orchestra.run.smithi022.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [855 kB] 2023-07-13T01:18:52.211 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [604 kB] 2023-07-13T01:18:52.222 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.235 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:18:52.246 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [620 kB] 2023-07-13T01:18:52.292 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [366 kB] 2023-07-13T01:18:52.351 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:18:52.372 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [620 kB] 2023-07-13T01:18:52.471 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-07-13T01:18:52.472 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [32.0 kB] 2023-07-13T01:18:52.473 INFO:teuthology.orchestra.run.smithi022.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [604 kB] 2023-07-13T01:18:52.491 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [620 kB] 2023-07-13T01:18:52.496 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [449 kB] 2023-07-13T01:18:52.511 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [366 kB] 2023-07-13T01:18:52.514 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [366 kB] 2023-07-13T01:18:52.517 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-07-13T01:18:52.518 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [33.3 kB] 2023-07-13T01:18:52.518 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,092 kB] 2023-07-13T01:18:52.524 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [177 kB] 2023-07-13T01:18:52.529 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-07-13T01:18:52.529 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [32.0 kB] 2023-07-13T01:18:52.531 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,987 kB] 2023-07-13T01:18:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-07-13T01:18:52.531 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,987 kB] 2023-07-13T01:18:52.544 INFO:teuthology.orchestra.run.smithi022.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [449 kB] 2023-07-13T01:18:52.562 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [449 kB] 2023-07-13T01:18:52.562 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-07-13T01:18:52.562 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,092 kB] 2023-07-13T01:18:52.616 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [277 kB] 2023-07-13T01:18:52.620 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,987 kB] 2023-07-13T01:18:52.622 INFO:teuthology.orchestra.run.smithi022.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [177 kB] 2023-07-13T01:18:52.626 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [32.0 kB] 2023-07-13T01:18:52.628 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [277 kB] 2023-07-13T01:18:52.634 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [291 kB] 2023-07-13T01:18:52.641 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [277 kB] 2023-07-13T01:18:52.643 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.643 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [604 kB] 2023-07-13T01:18:52.646 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.647 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [855 kB] 2023-07-13T01:18:52.650 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.650 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [604 kB] 2023-07-13T01:18:52.655 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.655 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [604 kB] 2023-07-13T01:18:52.670 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [855 kB] 2023-07-13T01:18:52.670 INFO:teuthology.orchestra.run.smithi022.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-07-13T01:18:52.673 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [33.3 kB] 2023-07-13T01:18:52.674 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [291 kB] 2023-07-13T01:18:52.678 INFO:teuthology.orchestra.run.smithi022.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,092 kB] 2023-07-13T01:18:52.684 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:52.689 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [855 kB] 2023-07-13T01:18:52.847 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:18:52.850 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.7 kB] 2023-07-13T01:18:52.858 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-07-13T01:18:52.862 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-07-13T01:18:52.873 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-07-13T01:18:52.876 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-07-13T01:18:52.911 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:18:52.922 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:18:52.945 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:18:52.953 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [258 kB] 2023-07-13T01:18:52.967 INFO:teuthology.orchestra.run.smithi022.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.7 kB] 2023-07-13T01:18:52.969 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [177 kB] 2023-07-13T01:18:52.970 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.2 kB] 2023-07-13T01:18:52.971 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-07-13T01:18:52.973 INFO:teuthology.orchestra.run.smithi022.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-07-13T01:18:52.973 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-07-13T01:18:52.977 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,424 B] 2023-07-13T01:18:52.977 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-07-13T01:18:52.978 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-07-13T01:18:52.981 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-07-13T01:18:52.982 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-07-13T01:18:52.984 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [177 kB] 2023-07-13T01:18:52.986 INFO:teuthology.orchestra.run.smithi022.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-07-13T01:18:52.989 INFO:teuthology.orchestra.run.smithi022.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-07-13T01:18:52.991 INFO:teuthology.orchestra.run.smithi022.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-07-13T01:18:53.031 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [258 kB] 2023-07-13T01:18:53.043 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.2 kB] 2023-07-13T01:18:53.046 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-07-13T01:18:53.047 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-07-13T01:18:53.048 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,424 B] 2023-07-13T01:18:53.048 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-07-13T01:18:53.049 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-07-13T01:18:53.050 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-07-13T01:18:53.053 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-07-13T01:18:53.061 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [177 kB] 2023-07-13T01:18:53.106 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-07-13T01:18:53.141 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-07-13T01:18:53.203 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-07-13T01:18:53.220 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-07-13T01:18:53.240 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-07-13T01:18:53.276 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-07-13T01:18:53.277 INFO:teuthology.orchestra.run.smithi022.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [33.3 kB] 2023-07-13T01:18:53.285 INFO:teuthology.orchestra.run.smithi022.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [291 kB] 2023-07-13T01:18:53.339 INFO:teuthology.orchestra.run.smithi022.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [576 B] 2023-07-13T01:18:53.408 INFO:teuthology.orchestra.run.smithi022.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:18:53.504 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.7 kB] 2023-07-13T01:18:53.519 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-07-13T01:18:53.525 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.7 kB] 2023-07-13T01:18:53.534 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-07-13T01:18:53.535 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-07-13T01:18:53.538 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-07-13T01:18:53.539 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-07-13T01:18:53.542 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-07-13T01:18:53.545 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-07-13T01:18:53.548 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-07-13T01:18:53.617 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.7 kB] 2023-07-13T01:18:53.620 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-07-13T01:18:53.626 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-07-13T01:18:53.628 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-07-13T01:18:53.629 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-07-13T01:18:53.739 INFO:teuthology.orchestra.run.smithi022.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:18:53.787 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:18:53.819 INFO:teuthology.orchestra.run.smithi022.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [258 kB] 2023-07-13T01:18:53.836 INFO:teuthology.orchestra.run.smithi022.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.2 kB] 2023-07-13T01:18:53.836 INFO:teuthology.orchestra.run.smithi022.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-07-13T01:18:53.837 INFO:teuthology.orchestra.run.smithi022.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-07-13T01:18:53.837 INFO:teuthology.orchestra.run.smithi022.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,424 B] 2023-07-13T01:18:53.837 INFO:teuthology.orchestra.run.smithi022.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-07-13T01:18:53.838 INFO:teuthology.orchestra.run.smithi022.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-07-13T01:18:53.844 INFO:teuthology.orchestra.run.smithi022.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-07-13T01:18:53.851 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [258 kB] 2023-07-13T01:18:53.860 INFO:teuthology.orchestra.run.smithi022.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-07-13T01:18:53.870 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.2 kB] 2023-07-13T01:18:53.871 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-07-13T01:18:53.872 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-07-13T01:18:53.874 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:18:53.875 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,424 B] 2023-07-13T01:18:53.875 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-07-13T01:18:53.876 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-07-13T01:18:53.926 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-07-13T01:18:53.928 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-07-13T01:18:53.937 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [258 kB] 2023-07-13T01:18:53.958 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.2 kB] 2023-07-13T01:18:53.960 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-07-13T01:18:53.963 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-07-13T01:18:53.964 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,424 B] 2023-07-13T01:18:53.965 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-07-13T01:18:53.965 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-07-13T01:18:53.991 INFO:teuthology.orchestra.run.smithi022.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-07-13T01:18:53.996 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-07-13T01:18:53.998 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-07-13T01:18:54.101 INFO:teuthology.orchestra.run.smithi022.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-07-13T01:18:54.136 INFO:teuthology.orchestra.run.smithi022.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-07-13T01:18:54.186 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-07-13T01:18:54.233 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-07-13T01:18:54.377 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-07-13T01:18:54.432 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-07-13T01:18:54.444 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-07-13T01:18:54.505 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-07-13T01:18:55.398 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 16.3 MB in 3s (5,373 kB/s) 2023-07-13T01:18:55.444 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 16.3 MB in 3s (5,374 kB/s) 2023-07-13T01:18:56.178 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 16.3 MB in 4s (4,491 kB/s) 2023-07-13T01:18:56.372 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 16.3 MB in 4s (4,066 kB/s) 2023-07-13T01:18:56.421 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 16.3 MB in 4s (4,151 kB/s) 2023-07-13T01:18:56.780 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-13T01:18:56.800 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2023-07-13T01:18:56.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:18:56.824 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:18:56.887 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-13T01:18:56.899 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2023-07-13T01:18:57.081 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2023-07-13T01:18:57.082 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2023-07-13T01:18:57.090 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2023-07-13T01:18:57.090 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2023-07-13T01:18:57.250 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2023-07-13T01:18:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:57.250 INFO:teuthology.orchestra.run.smithi137.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-modules-5.15.0-76-generic 2023-07-13T01:18:57.251 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-extra-5.15.0-76-generic thermald upower usbmuxd 2023-07-13T01:18:57.251 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2023-07-13T01:18:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2023-07-13T01:18:57.252 INFO:teuthology.orchestra.run.smithi137.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-76-generic 2023-07-13T01:18:57.254 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2023-07-13T01:18:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-modules-5.15.0-76-generic 2023-07-13T01:18:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: linux-modules-extra-5.15.0-76-generic thermald upower usbmuxd 2023-07-13T01:18:57.256 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2023-07-13T01:18:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2023-07-13T01:18:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-76-generic 2023-07-13T01:18:57.302 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2023-07-13T01:18:57.303 INFO:teuthology.orchestra.run.smithi137.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-image-generic-hwe-20.04 2023-07-13T01:18:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: linux-modules-5.15.0-76-generic linux-modules-extra-5.15.0-76-generic 2023-07-13T01:18:57.304 INFO:teuthology.orchestra.run.smithi137.stdout: thermald upower usbmuxd 2023-07-13T01:18:57.307 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2023-07-13T01:18:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-image-generic-hwe-20.04 2023-07-13T01:18:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: linux-modules-5.15.0-76-generic linux-modules-extra-5.15.0-76-generic 2023-07-13T01:18:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: thermald upower usbmuxd 2023-07-13T01:18:57.507 INFO:teuthology.orchestra.run.smithi103.stdout:0 upgraded, 13 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:18:57.507 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 90.8 MB of archives. 2023-07-13T01:18:57.507 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 497 MB of additional disk space will be used. 2023-07-13T01:18:57.507 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2023-07-13T01:18:57.513 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 13 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:18:57.513 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 90.8 MB of archives. 2023-07-13T01:18:57.513 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 497 MB of additional disk space will be used. 2023-07-13T01:18:57.513 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2023-07-13T01:18:57.644 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2023-07-13T01:18:57.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:18:57.746 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2023-07-13T01:18:57.754 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-07-13T01:18:57.768 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-13T01:18:57.778 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:18:57.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:18:57.843 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2023-07-13T01:18:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-07-13T01:18:57.860 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-13T01:18:57.874 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2023-07-13T01:18:57.895 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2023-07-13T01:18:57.918 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2023-07-13T01:18:57.920 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2023-07-13T01:18:57.946 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2023-07-13T01:18:57.947 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2023-07-13T01:18:57.955 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2023-07-13T01:18:57.998 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2023-07-13T01:18:58.038 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2023-07-13T01:18:58.039 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-07-13T01:18:58.040 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-07-13T01:18:58.048 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [20.9 MB] 2023-07-13T01:18:58.052 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-07-13T01:18:58.053 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-07-13T01:18:58.094 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [20.9 MB] 2023-07-13T01:18:58.120 INFO:teuthology.orchestra.run.smithi022.stdout:The following additional packages will be installed: 2023-07-13T01:18:58.120 INFO:teuthology.orchestra.run.smithi022.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:58.121 INFO:teuthology.orchestra.run.smithi022.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-modules-5.15.0-76-generic 2023-07-13T01:18:58.121 INFO:teuthology.orchestra.run.smithi022.stdout: linux-modules-extra-5.15.0-76-generic thermald upower usbmuxd 2023-07-13T01:18:58.122 INFO:teuthology.orchestra.run.smithi022.stdout:Suggested packages: 2023-07-13T01:18:58.122 INFO:teuthology.orchestra.run.smithi022.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2023-07-13T01:18:58.122 INFO:teuthology.orchestra.run.smithi022.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-76-generic 2023-07-13T01:18:58.178 INFO:teuthology.orchestra.run.smithi022.stdout:The following NEW packages will be installed: 2023-07-13T01:18:58.179 INFO:teuthology.orchestra.run.smithi022.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:58.179 INFO:teuthology.orchestra.run.smithi022.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-image-generic-hwe-20.04 2023-07-13T01:18:58.179 INFO:teuthology.orchestra.run.smithi022.stdout: linux-modules-5.15.0-76-generic linux-modules-extra-5.15.0-76-generic 2023-07-13T01:18:58.180 INFO:teuthology.orchestra.run.smithi022.stdout: thermald upower usbmuxd 2023-07-13T01:18:58.214 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2023-07-13T01:18:58.215 INFO:teuthology.orchestra.run.smithi084.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:58.215 INFO:teuthology.orchestra.run.smithi084.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-modules-5.15.0-76-generic 2023-07-13T01:18:58.216 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-extra-5.15.0-76-generic thermald upower usbmuxd 2023-07-13T01:18:58.216 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2023-07-13T01:18:58.216 INFO:teuthology.orchestra.run.smithi154.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:58.216 INFO:teuthology.orchestra.run.smithi154.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-modules-5.15.0-76-generic 2023-07-13T01:18:58.217 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-76-generic thermald upower usbmuxd 2023-07-13T01:18:58.217 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2023-07-13T01:18:58.217 INFO:teuthology.orchestra.run.smithi154.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2023-07-13T01:18:58.217 INFO:teuthology.orchestra.run.smithi154.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-76-generic 2023-07-13T01:18:58.218 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2023-07-13T01:18:58.218 INFO:teuthology.orchestra.run.smithi084.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2023-07-13T01:18:58.218 INFO:teuthology.orchestra.run.smithi084.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-76-generic 2023-07-13T01:18:58.269 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2023-07-13T01:18:58.269 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2023-07-13T01:18:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-image-generic-hwe-20.04 2023-07-13T01:18:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-76-generic linux-modules-extra-5.15.0-76-generic 2023-07-13T01:18:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: thermald upower usbmuxd 2023-07-13T01:18:58.271 INFO:teuthology.orchestra.run.smithi084.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-07-13T01:18:58.271 INFO:teuthology.orchestra.run.smithi084.stdout: libusbmuxd6 linux-image-5.15.0-76-generic linux-image-generic-hwe-20.04 2023-07-13T01:18:58.271 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-5.15.0-76-generic linux-modules-extra-5.15.0-76-generic 2023-07-13T01:18:58.271 INFO:teuthology.orchestra.run.smithi084.stdout: thermald upower usbmuxd 2023-07-13T01:18:58.409 INFO:teuthology.orchestra.run.smithi022.stdout:0 upgraded, 13 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:18:58.410 INFO:teuthology.orchestra.run.smithi022.stdout:Need to get 90.8 MB of archives. 2023-07-13T01:18:58.410 INFO:teuthology.orchestra.run.smithi022.stdout:After this operation, 497 MB of additional disk space will be used. 2023-07-13T01:18:58.410 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2023-07-13T01:18:58.527 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 13 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:18:58.528 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 90.8 MB of archives. 2023-07-13T01:18:58.528 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 497 MB of additional disk space will be used. 2023-07-13T01:18:58.528 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2023-07-13T01:18:58.529 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 13 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:18:58.529 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 90.8 MB of archives. 2023-07-13T01:18:58.529 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 497 MB of additional disk space will be used. 2023-07-13T01:18:58.529 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2023-07-13T01:18:58.822 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2023-07-13T01:18:58.863 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2023-07-13T01:18:58.869 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2023-07-13T01:18:58.984 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2023-07-13T01:18:58.999 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2023-07-13T01:18:59.048 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2023-07-13T01:18:59.119 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2023-07-13T01:18:59.160 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2023-07-13T01:18:59.173 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [20.9 MB] 2023-07-13T01:18:59.177 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2023-07-13T01:18:59.177 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2023-07-13T01:18:59.212 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2023-07-13T01:18:59.258 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [20.9 MB] 2023-07-13T01:18:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2023-07-13T01:18:59.361 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [20.9 MB] 2023-07-13T01:18:59.835 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [11.3 MB] 2023-07-13T01:19:00.098 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [11.3 MB] 2023-07-13T01:19:00.782 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [57.9 MB] 2023-07-13T01:19:00.892 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [11.3 MB] 2023-07-13T01:19:00.953 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [57.9 MB] 2023-07-13T01:19:00.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [11.3 MB] 2023-07-13T01:19:01.020 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [11.3 MB] 2023-07-13T01:19:01.575 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [57.9 MB] 2023-07-13T01:19:01.766 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [57.9 MB] 2023-07-13T01:19:01.825 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-76-generic amd64 5.15.0-76.83~20.04.1 [57.9 MB] 2023-07-13T01:19:05.714 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.76.83~20.04.37 [2,716 B] 2023-07-13T01:19:05.714 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2023-07-13T01:19:05.715 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2023-07-13T01:19:05.881 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.76.83~20.04.37 [2,716 B] 2023-07-13T01:19:05.921 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2023-07-13T01:19:05.922 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2023-07-13T01:19:06.006 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2023-07-13T01:19:06.220 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2023-07-13T01:19:06.275 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.76.83~20.04.37 [2,716 B] 2023-07-13T01:19:06.351 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2023-07-13T01:19:06.351 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2023-07-13T01:19:06.437 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.76.83~20.04.37 [2,716 B] 2023-07-13T01:19:06.437 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2023-07-13T01:19:06.438 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2023-07-13T01:19:06.604 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2023-07-13T01:19:06.614 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2023-07-13T01:19:06.673 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2023-07-13T01:19:06.705 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.76.83~20.04.37 [2,716 B] 2023-07-13T01:19:06.705 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2023-07-13T01:19:06.706 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2023-07-13T01:19:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2023-07-13T01:19:06.899 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2023-07-13T01:19:07.019 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2023-07-13T01:19:07.099 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2023-07-13T01:19:07.270 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 90.8 MB in 9s (9,732 kB/s) 2023-07-13T01:19:07.278 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2023-07-13T01:19:07.480 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2023-07-13T01:19:07.508 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 90.8 MB in 9s (10.5 MB/s) 2023-07-13T01:19:07.719 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 90.8 MB in 9s (10.4 MB/s) 2023-07-13T01:19:07.734 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2023-07-13T01:19:07.787 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 90.8 MB in 9s (10.3 MB/s) 2023-07-13T01:19:07.959 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2023-07-13T01:19:07.998 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 90.8 MB in 10s (9,091 kB/s) 2023-07-13T01:19:08.015 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2023-07-13T01:19:08.203 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2023-07-13T01:19:09.251 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-07-13T01:19:09.256 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2023-07-13T01:19:09.413 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-07-13T01:19:09.443 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2023-07-13T01:19:09.623 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:09.679 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-07-13T01:19:09.684 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2023-07-13T01:19:09.785 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-07-13T01:19:09.790 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2023-07-13T01:19:09.790 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libplist3:amd64. 2023-07-13T01:19:09.803 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2023-07-13T01:19:09.815 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:09.840 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:09.990 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-07-13T01:19:09.995 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2023-07-13T01:19:10.001 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libplist3:amd64. 2023-07-13T01:19:10.014 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2023-07-13T01:19:10.045 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:10.051 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:10.135 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libplist3:amd64. 2023-07-13T01:19:10.147 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2023-07-13T01:19:10.151 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:10.176 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:10.194 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2023-07-13T01:19:10.210 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2023-07-13T01:19:10.244 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:10.337 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2023-07-13T01:19:10.352 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2023-07-13T01:19:10.412 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:10.441 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplist3:amd64. 2023-07-13T01:19:10.454 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2023-07-13T01:19:10.479 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2023-07-13T01:19:10.492 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2023-07-13T01:19:10.513 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2023-07-13T01:19:10.515 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:10.526 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2023-07-13T01:19:10.529 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:10.546 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libplist3:amd64. 2023-07-13T01:19:10.559 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2023-07-13T01:19:10.563 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:10.596 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:10.723 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2023-07-13T01:19:10.737 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2023-07-13T01:19:10.773 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:10.843 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2023-07-13T01:19:10.857 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2023-07-13T01:19:10.890 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2023-07-13T01:19:10.904 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2023-07-13T01:19:10.916 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2023-07-13T01:19:10.927 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:10.930 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2023-07-13T01:19:10.932 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libupower-glib3:amd64. 2023-07-13T01:19:10.945 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:10.948 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:10.974 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:10.982 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:11.118 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libupower-glib3:amd64. 2023-07-13T01:19:11.132 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:11.176 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:11.246 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2023-07-13T01:19:11.261 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2023-07-13T01:19:11.268 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libupower-glib3:amd64. 2023-07-13T01:19:11.283 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:11.304 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:11.319 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2023-07-13T01:19:11.326 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:11.327 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-5.15.0-76-generic. 2023-07-13T01:19:11.331 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2023-07-13T01:19:11.340 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../05-linux-modules-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:11.369 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:11.377 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:11.495 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-modules-5.15.0-76-generic. 2023-07-13T01:19:11.509 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../05-linux-modules-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:11.553 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:11.671 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-5.15.0-76-generic. 2023-07-13T01:19:11.683 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libupower-glib3:amd64. 2023-07-13T01:19:11.684 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../05-linux-modules-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:11.697 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:11.714 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libupower-glib3:amd64. 2023-07-13T01:19:11.727 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:11.729 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:11.741 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:11.764 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:12.069 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-76-generic. 2023-07-13T01:19:12.084 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-linux-modules-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:12.092 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-modules-5.15.0-76-generic. 2023-07-13T01:19:12.106 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../05-linux-modules-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:12.119 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:12.150 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:13.961 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-image-5.15.0-76-generic. 2023-07-13T01:19:13.974 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../06-linux-image-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.065 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.104 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-image-5.15.0-76-generic. 2023-07-13T01:19:14.117 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../06-linux-image-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.188 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-image-5.15.0-76-generic. 2023-07-13T01:19:14.202 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../06-linux-image-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.234 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.310 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.547 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-76-generic. 2023-07-13T01:19:14.560 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.589 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.703 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-76-generic. 2023-07-13T01:19:14.711 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-image-5.15.0-76-generic. 2023-07-13T01:19:14.717 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-linux-image-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.724 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../06-linux-image-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.782 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-76-generic. 2023-07-13T01:19:14.796 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.801 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-76-generic. 2023-07-13T01:19:14.814 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:14.818 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.831 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.840 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:14.851 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:15.323 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-76-generic. 2023-07-13T01:19:15.337 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:15.381 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:15.623 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-76-generic. 2023-07-13T01:19:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-76-generic_5.15.0-76.83~20.04.1_amd64.deb ... 2023-07-13T01:19:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:21.549 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2023-07-13T01:19:21.555 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2023-07-13T01:19:21.566 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.76.83~20.04.37_amd64.deb ... 2023-07-13T01:19:21.571 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.76.83~20.04.37_amd64.deb ... 2023-07-13T01:19:21.607 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:21.622 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:21.739 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2023-07-13T01:19:21.757 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.76.83~20.04.37_amd64.deb ... 2023-07-13T01:19:21.797 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:21.943 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libevdev2:amd64. 2023-07-13T01:19:21.949 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libevdev2:amd64. 2023-07-13T01:19:21.957 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2023-07-13T01:19:21.964 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2023-07-13T01:19:22.001 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:22.116 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libevdev2:amd64. 2023-07-13T01:19:22.132 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2023-07-13T01:19:22.183 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:22.234 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2023-07-13T01:19:22.249 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.76.83~20.04.37_amd64.deb ... 2023-07-13T01:19:22.292 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:22.354 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package thermald. 2023-07-13T01:19:22.371 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2023-07-13T01:19:22.394 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package thermald. 2023-07-13T01:19:22.409 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2023-07-13T01:19:22.412 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:22.460 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2023-07-13T01:19:22.520 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.76.83~20.04.37_amd64.deb ... 2023-07-13T01:19:22.561 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package thermald. 2023-07-13T01:19:22.563 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:22.576 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2023-07-13T01:19:22.619 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:22.636 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libevdev2:amd64. 2023-07-13T01:19:22.650 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2023-07-13T01:19:22.694 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libevdev2:amd64. 2023-07-13T01:19:22.912 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2023-07-13T01:19:22.949 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:22.958 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package upower. 2023-07-13T01:19:22.971 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:22.998 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package upower. 2023-07-13T01:19:23.015 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:23.025 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking upower (0.99.11-1build2) ... 2023-07-13T01:19:23.072 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking upower (0.99.11-1build2) ... 2023-07-13T01:19:23.106 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package thermald. 2023-07-13T01:19:23.121 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2023-07-13T01:19:23.164 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:23.207 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package upower. 2023-07-13T01:19:23.223 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:23.285 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking upower (0.99.11-1build2) ... 2023-07-13T01:19:23.342 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package thermald. 2023-07-13T01:19:23.358 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2023-07-13T01:19:23.394 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:23.421 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usbmuxd. 2023-07-13T01:19:23.434 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2023-07-13T01:19:23.479 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:23.494 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package usbmuxd. 2023-07-13T01:19:23.512 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2023-07-13T01:19:23.552 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:23.712 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package usbmuxd. 2023-07-13T01:19:23.728 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2023-07-13T01:19:23.748 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package upower. 2023-07-13T01:19:23.765 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:23.770 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:23.795 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:23.826 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking upower (0.99.11-1build2) ... 2023-07-13T01:19:23.891 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:23.916 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:23.924 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package upower. 2023-07-13T01:19:23.939 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2023-07-13T01:19:23.999 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking upower (0.99.11-1build2) ... 2023-07-13T01:19:24.023 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:24.051 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:24.059 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:24.166 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:24.177 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:24.199 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:24.249 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package usbmuxd. 2023-07-13T01:19:24.262 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2023-07-13T01:19:24.292 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:24.303 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:24.307 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:24.342 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:24.418 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:24.420 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package usbmuxd. 2023-07-13T01:19:24.429 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:24.435 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2023-07-13T01:19:24.468 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:24.470 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:24.569 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:24.571 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up upower (0.99.11-1build2) ... 2023-07-13T01:19:24.594 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:24.615 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:24.695 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up upower (0.99.11-1build2) ... 2023-07-13T01:19:24.728 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:24.753 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:24.785 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2023-07-13T01:19:24.838 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up upower (0.99.11-1build2) ... 2023-07-13T01:19:24.879 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:24.909 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-07-13T01:19:25.005 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:25.035 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2023-07-13T01:19:25.110 INFO:teuthology.orchestra.run.smithi084.stdout:upower.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:25.131 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:25.161 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2023-07-13T01:19:25.167 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:25.225 INFO:teuthology.orchestra.run.smithi022.stdout:upower.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:25.266 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:25.282 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:25.287 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-07-13T01:19:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2023-07-13T01:19:25.363 INFO:teuthology.orchestra.run.smithi137.stdout:upower.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user `usbmux' (UID 114) ... 2023-07-13T01:19:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2023-07-13T01:19:25.383 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up upower (0.99.11-1build2) ... 2023-07-13T01:19:25.417 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:25.422 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-07-13T01:19:25.518 INFO:teuthology.orchestra.run.smithi022.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2023-07-13T01:19:25.528 INFO:teuthology.orchestra.run.smithi022.stdout:Adding system user `usbmux' (UID 114) ... 2023-07-13T01:19:25.529 INFO:teuthology.orchestra.run.smithi022.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2023-07-13T01:19:25.584 INFO:teuthology.orchestra.run.smithi137.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2023-07-13T01:19:25.593 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user `usbmux' (UID 114) ... 2023-07-13T01:19:25.594 INFO:teuthology.orchestra.run.smithi137.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2023-07-13T01:19:25.909 INFO:teuthology.orchestra.run.smithi084.stdout:Not creating home directory `/var/lib/usbmux'. 2023-07-13T01:19:26.049 INFO:teuthology.orchestra.run.smithi022.stdout:Not creating home directory `/var/lib/usbmux'. 2023-07-13T01:19:26.129 INFO:teuthology.orchestra.run.smithi084.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:26.172 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:26.263 INFO:teuthology.orchestra.run.smithi022.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:26.320 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:26.344 INFO:teuthology.orchestra.run.smithi154.stdout:upower.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:26.432 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up upower (0.99.11-1build2) ... 2023-07-13T01:19:26.487 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:26.487 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:26.890 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:26.981 INFO:teuthology.orchestra.run.smithi103.stdout:upower.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:27.036 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-07-13T01:19:27.055 INFO:teuthology.orchestra.run.smithi137.stdout:Not creating home directory `/var/lib/usbmux'. 2023-07-13T01:19:27.094 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2023-07-13T01:19:27.099 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user `usbmux' (UID 114) ... 2023-07-13T01:19:27.099 INFO:teuthology.orchestra.run.smithi154.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2023-07-13T01:19:27.118 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:27.118 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:27.228 INFO:teuthology.orchestra.run.smithi103.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2023-07-13T01:19:27.234 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user `usbmux' (UID 114) ... 2023-07-13T01:19:27.235 INFO:teuthology.orchestra.run.smithi103.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2023-07-13T01:19:27.256 INFO:teuthology.orchestra.run.smithi137.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:27.301 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:27.591 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:27.606 INFO:teuthology.orchestra.run.smithi154.stdout:Not creating home directory `/var/lib/usbmux'. 2023-07-13T01:19:27.697 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:27.779 INFO:teuthology.orchestra.run.smithi103.stdout:Not creating home directory `/var/lib/usbmux'. 2023-07-13T01:19:27.827 INFO:teuthology.orchestra.run.smithi154.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:27.877 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:28.004 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:28.005 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:28.006 INFO:teuthology.orchestra.run.smithi103.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2023-07-13T01:19:28.058 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2023-07-13T01:19:28.190 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:28.191 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:28.409 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:28.410 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2023-07-13T01:19:28.468 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:28.697 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:28.745 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:28.854 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-modules-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:29.194 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:29.871 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:30.077 INFO:teuthology.orchestra.run.smithi084.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:30.077 INFO:teuthology.orchestra.run.smithi084.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:30.126 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:30.230 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:30.292 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:30.583 INFO:teuthology.orchestra.run.smithi022.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:30.584 INFO:teuthology.orchestra.run.smithi022.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:30.729 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:31.190 INFO:teuthology.orchestra.run.smithi137.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:31.190 INFO:teuthology.orchestra.run.smithi137.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:31.322 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:31.597 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:31.723 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:19:31.965 INFO:teuthology.orchestra.run.smithi103.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:31.966 INFO:teuthology.orchestra.run.smithi103.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:32.028 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:19:32.119 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-modules-extra-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:32.179 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:32.305 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:19:32.681 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:32.807 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:19:33.096 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:19:33.145 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:33.262 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:19:33.272 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-13T01:19:33.369 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:19:33.372 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:33.440 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-07-13T01:19:33.441 INFO:teuthology.orchestra.run.smithi084.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:33.503 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.76.83~20.04.37) ... 2023-07-13T01:19:33.543 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:19:33.629 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:19:33.824 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-13T01:19:33.941 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:33.943 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:19:34.009 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-07-13T01:19:34.009 INFO:teuthology.orchestra.run.smithi137.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:34.247 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-13T01:19:34.271 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-13T01:19:34.355 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:34.380 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:34.414 INFO:teuthology.orchestra.run.smithi022.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-07-13T01:19:34.414 INFO:teuthology.orchestra.run.smithi022.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:34.458 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-07-13T01:19:34.458 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:34.705 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-13T01:19:34.813 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for linux-image-5.15.0-76-generic (5.15.0-76.83~20.04.1) ... 2023-07-13T01:19:34.890 INFO:teuthology.orchestra.run.smithi103.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-07-13T01:19:34.891 INFO:teuthology.orchestra.run.smithi103.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:58.837 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-07-13T01:19:58.837 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub' 2023-07-13T01:19:58.859 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:19:58.894 INFO:teuthology.orchestra.run.smithi084.stdout:Generating grub configuration file ... 2023-07-13T01:19:59.216 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:59.234 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:59.435 INFO:teuthology.orchestra.run.smithi137.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-07-13T01:19:59.435 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub' 2023-07-13T01:19:59.444 INFO:teuthology.orchestra.run.smithi137.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:19:59.461 INFO:teuthology.orchestra.run.smithi137.stdout:Generating grub configuration file ... 2023-07-13T01:19:59.622 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:19:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:19:59.758 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-07-13T01:19:59.759 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2023-07-13T01:19:59.760 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:19:59.779 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:19:59.787 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:19:59.800 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2023-07-13T01:20:00.145 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:00.170 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:00.198 INFO:teuthology.orchestra.run.smithi137.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:00.208 INFO:teuthology.orchestra.run.smithi137.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-07-13T01:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout:Sourcing file `/etc/default/grub' 2023-07-13T01:20:00.423 INFO:teuthology.orchestra.run.smithi103.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-07-13T01:20:00.423 INFO:teuthology.orchestra.run.smithi103.stdout:Sourcing file `/etc/default/grub' 2023-07-13T01:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout:Generating grub configuration file ... 2023-07-13T01:20:00.457 INFO:teuthology.orchestra.run.smithi103.stdout:Generating grub configuration file ... 2023-07-13T01:20:00.651 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:00.663 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:00.767 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:00.786 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:01.143 INFO:teuthology.orchestra.run.smithi022.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:01.155 INFO:teuthology.orchestra.run.smithi022.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:01.173 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:01.185 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:01.975 INFO:teuthology.orchestra.run.smithi137.stdout:done 2023-07-13T01:20:02.324 INFO:teuthology.orchestra.run.smithi084.stdout:done 2023-07-13T01:20:02.396 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:02.453 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 20 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2023-07-13T01:20:02.454 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:02.455 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2023-07-13T01:20:02.456 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:02.456 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2023-07-13T01:20:02.457 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-76-generic 2023-07-13T01:20:02.457 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T01:20:02.457 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T01:20:02.457 INFO:teuthology.task.kernel:Installing distro kernel on host.d... 2023-07-13T01:20:02.457 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T01:20:02.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get clean 2023-07-13T01:20:02.543 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2023-07-13T01:20:02.771 DEBUG:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2023-07-13T01:20:02.821 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2023-07-13T01:20:02.822 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2023-07-13T01:20:02.822 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 20 2023-07-13T01:20:02.822 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:02.822 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2023-07-13T01:20:02.822 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:02.822 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2023-07-13T01:20:02.823 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:02.823 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2023-07-13T01:20:02.824 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-76-generic 2023-07-13T01:20:02.824 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T01:20:02.824 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T01:20:02.824 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2023-07-13T01:20:02.825 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T01:20:02.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2023-07-13T01:20:02.826 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:20:02.827 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-13T01:20:02.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2023-07-13T01:20:02.911 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:20:02.997 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-13T01:20:03.031 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:20:03.032 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-13T01:20:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:20:03.068 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-13T01:20:03.309 INFO:teuthology.orchestra.run.smithi154.stdout:done 2023-07-13T01:20:03.329 INFO:teuthology.orchestra.run.smithi022.stdout:done 2023-07-13T01:20:03.422 INFO:teuthology.orchestra.run.smithi103.stdout:done 2023-07-13T01:20:03.747 DEBUG:teuthology.orchestra.run.smithi022:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:03.764 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:03.793 INFO:teuthology.orchestra.run.smithi022.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Status: install ok installed 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Priority: optional 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Section: kernel 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Installed-Size: 20 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: amd64 2023-07-13T01:20:03.794 INFO:teuthology.orchestra.run.smithi022.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout:Recommends: thermald 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:03.795 INFO:teuthology.orchestra.run.smithi022.stdout: available. 2023-07-13T01:20:03.796 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-76-generic 2023-07-13T01:20:03.796 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T01:20:03.796 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T01:20:03.796 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-07-13T01:20:03.796 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T01:20:03.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get clean 2023-07-13T01:20:03.821 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:03.821 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 20 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:03.822 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:03.823 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:03.823 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:03.823 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2023-07-13T01:20:03.823 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:03.823 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:03.823 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2023-07-13T01:20:03.823 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-76-generic 2023-07-13T01:20:03.824 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T01:20:03.824 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T01:20:03.824 INFO:teuthology.task.kernel:Installing distro kernel on host.e... 2023-07-13T01:20:03.824 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T01:20:03.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2023-07-13T01:20:03.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2023-07-13T01:20:03.888 DEBUG:teuthology.orchestra.run.smithi103:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:03.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2023-07-13T01:20:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:Status: install ok installed 2023-07-13T01:20:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:Priority: optional 2023-07-13T01:20:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:Section: kernel 2023-07-13T01:20:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:Installed-Size: 20 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: amd64 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:Recommends: thermald 2023-07-13T01:20:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:03.946 INFO:teuthology.orchestra.run.smithi103.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:03.946 INFO:teuthology.orchestra.run.smithi103.stdout: available. 2023-07-13T01:20:03.946 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-76-generic 2023-07-13T01:20:03.946 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-07-13T01:20:03.946 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-07-13T01:20:03.947 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2023-07-13T01:20:03.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2023-07-13T01:20:03.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get clean 2023-07-13T01:20:04.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2023-07-13T01:20:04.115 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:20:04.116 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-13T01:20:04.171 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:20:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:20:04.224 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-13T01:20:04.240 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-13T01:20:04.350 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:20:04.374 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:20:04.375 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-13T01:20:04.492 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-13T01:20:04.507 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:20:04.551 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2023-07-13T01:20:04.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:20:04.643 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2023-07-13T01:20:04.644 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-13T01:20:04.745 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-07-13T01:20:04.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:20:04.838 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2023-07-13T01:20:04.839 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2023-07-13T01:20:04.840 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-07-13T01:20:05.035 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-07-13T01:20:05.035 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-07-13T01:20:05.041 INFO:teuthology.orchestra.run.smithi137.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.76.83~20.04.37). 2023-07-13T01:20:05.042 INFO:teuthology.orchestra.run.smithi137.stdout:0 upgraded, 0 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:20:05.043 DEBUG:teuthology.orchestra.run.smithi137:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:05.064 INFO:teuthology.orchestra.run.smithi137.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:05.065 INFO:teuthology.orchestra.run.smithi137.stdout:Status: install ok installed 2023-07-13T01:20:05.065 INFO:teuthology.orchestra.run.smithi137.stdout:Priority: optional 2023-07-13T01:20:05.065 INFO:teuthology.orchestra.run.smithi137.stdout:Section: kernel 2023-07-13T01:20:05.066 INFO:teuthology.orchestra.run.smithi137.stdout:Installed-Size: 20 2023-07-13T01:20:05.066 INFO:teuthology.orchestra.run.smithi137.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:05.066 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: amd64 2023-07-13T01:20:05.066 INFO:teuthology.orchestra.run.smithi137.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:05.067 INFO:teuthology.orchestra.run.smithi137.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:05.067 INFO:teuthology.orchestra.run.smithi137.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:05.067 INFO:teuthology.orchestra.run.smithi137.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:05.068 INFO:teuthology.orchestra.run.smithi137.stdout:Recommends: thermald 2023-07-13T01:20:05.068 INFO:teuthology.orchestra.run.smithi137.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:05.068 INFO:teuthology.orchestra.run.smithi137.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:05.069 INFO:teuthology.orchestra.run.smithi137.stdout: available. 2023-07-13T01:20:05.069 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2023-07-13T01:20:05.074 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.wQNxKXDbbQ 2023-07-13T01:20:05.074 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wQNxKXDbbQ 2023-07-13T01:20:05.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.wQNxKXDbbQ 2023-07-13T01:20:05.173 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.wQNxKXDbbQ is 9KB 2023-07-13T01:20:05.188 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.wQNxKXDbbQ 2023-07-13T01:20:05.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:05.247 INFO:teuthology.orchestra.run.smithi084.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.76.83~20.04.37). 2023-07-13T01:20:05.247 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 0 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:20:05.249 DEBUG:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:05.250 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:20:05.250 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-07-13T01:20:05.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:05.267 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:05.268 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2023-07-13T01:20:05.268 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2023-07-13T01:20:05.268 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2023-07-13T01:20:05.268 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 20 2023-07-13T01:20:05.268 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:05.268 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2023-07-13T01:20:05.270 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-07-13T01:20:05.274 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.wiJYCInAOp 2023-07-13T01:20:05.274 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wiJYCInAOp 2023-07-13T01:20:05.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.wiJYCInAOp 2023-07-13T01:20:05.285 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-76-generic 2023-07-13T01:20:05.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo update-grub 2023-07-13T01:20:05.322 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.wiJYCInAOp is 9KB 2023-07-13T01:20:05.335 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.wiJYCInAOp 2023-07-13T01:20:05.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:05.396 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:20:05.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-07-13T01:20:05.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:05.434 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-76-generic 2023-07-13T01:20:05.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo update-grub 2023-07-13T01:20:05.792 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-13T01:20:05.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:20:05.887 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-13T01:20:05.974 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2023-07-13T01:20:06.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:20:06.071 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2023-07-13T01:20:06.075 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-13T01:20:06.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-07-13T01:20:06.101 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-07-13T01:20:06.101 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-07-13T01:20:06.213 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-13T01:20:06.250 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2023-07-13T01:20:06.251 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2023-07-13T01:20:06.323 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.76.83~20.04.37). 2023-07-13T01:20:06.324 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:20:06.325 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:06.343 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:06.343 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2023-07-13T01:20:06.343 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 20 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:06.344 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:06.345 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:06.345 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2023-07-13T01:20:06.345 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:06.345 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:06.345 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2023-07-13T01:20:06.345 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-07-13T01:20:06.350 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.WKEZcLjWBe 2023-07-13T01:20:06.350 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.WKEZcLjWBe 2023-07-13T01:20:06.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.WKEZcLjWBe 2023-07-13T01:20:06.407 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2023-07-13T01:20:06.408 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2023-07-13T01:20:06.439 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.WKEZcLjWBe is 9KB 2023-07-13T01:20:06.452 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.WKEZcLjWBe 2023-07-13T01:20:06.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.460 INFO:teuthology.orchestra.run.smithi022.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.76.83~20.04.37). 2023-07-13T01:20:06.461 INFO:teuthology.orchestra.run.smithi022.stdout:0 upgraded, 0 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:20:06.462 DEBUG:teuthology.orchestra.run.smithi022:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:06.480 INFO:teuthology.orchestra.run.smithi022.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:06.480 INFO:teuthology.orchestra.run.smithi022.stdout:Status: install ok installed 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Priority: optional 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Section: kernel 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Installed-Size: 20 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: amd64 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:06.481 INFO:teuthology.orchestra.run.smithi022.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:06.482 INFO:teuthology.orchestra.run.smithi022.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:06.482 INFO:teuthology.orchestra.run.smithi022.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:06.482 INFO:teuthology.orchestra.run.smithi022.stdout:Recommends: thermald 2023-07-13T01:20:06.482 INFO:teuthology.orchestra.run.smithi022.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:06.482 INFO:teuthology.orchestra.run.smithi022.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:06.482 INFO:teuthology.orchestra.run.smithi022.stdout: available. 2023-07-13T01:20:06.482 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-07-13T01:20:06.488 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.xFedUsJHvz 2023-07-13T01:20:06.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub/grub.cfg /tmp/tmp.xFedUsJHvz 2023-07-13T01:20:06.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.xFedUsJHvz 2023-07-13T01:20:06.513 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:20:06.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.513 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.533 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.xFedUsJHvz is 9KB 2023-07-13T01:20:06.546 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.xFedUsJHvz 2023-07-13T01:20:06.548 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-76-generic 2023-07-13T01:20:06.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2023-07-13T01:20:06.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.607 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:20:06.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.618 INFO:teuthology.orchestra.run.smithi103.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.76.83~20.04.37). 2023-07-13T01:20:06.619 INFO:teuthology.orchestra.run.smithi103.stdout:0 upgraded, 0 newly installed, 0 to remove and 228 not upgraded. 2023-07-13T01:20:06.620 DEBUG:teuthology.orchestra.run.smithi103:> dpkg -s linux-image-generic-hwe-20.04 2023-07-13T01:20:06.623 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub' 2023-07-13T01:20:06.631 INFO:teuthology.orchestra.run.smithi137.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:06.641 INFO:teuthology.orchestra.run.smithi103.stdout:Package: linux-image-generic-hwe-20.04 2023-07-13T01:20:06.641 INFO:teuthology.orchestra.run.smithi103.stdout:Status: install ok installed 2023-07-13T01:20:06.641 INFO:teuthology.orchestra.run.smithi103.stdout:Priority: optional 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Section: kernel 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Installed-Size: 20 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Maintainer: Ubuntu Kernel Team 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: amd64 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Source: linux-meta-hwe-5.15 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Version: 5.15.0.76.83~20.04.37 2023-07-13T01:20:06.642 INFO:teuthology.orchestra.run.smithi103.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-76), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-07-13T01:20:06.643 INFO:teuthology.orchestra.run.smithi103.stdout:Depends: linux-image-5.15.0-76-generic, linux-modules-extra-5.15.0-76-generic, linux-firmware, intel-microcode, amd64-microcode 2023-07-13T01:20:06.643 INFO:teuthology.orchestra.run.smithi103.stdout:Recommends: thermald 2023-07-13T01:20:06.643 INFO:teuthology.orchestra.run.smithi103.stdout:Description: Generic Linux kernel image 2023-07-13T01:20:06.643 INFO:teuthology.orchestra.run.smithi103.stdout: This package will always depend on the latest generic kernel image 2023-07-13T01:20:06.643 INFO:teuthology.orchestra.run.smithi103.stdout: available. 2023-07-13T01:20:06.643 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2023-07-13T01:20:06.644 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-76-generic 2023-07-13T01:20:06.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo update-grub 2023-07-13T01:20:06.646 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2023-07-13T01:20:06.650 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.oFozIHYPPg 2023-07-13T01:20:06.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub/grub.cfg /tmp/tmp.oFozIHYPPg 2023-07-13T01:20:06.688 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub' 2023-07-13T01:20:06.698 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:06.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.oFozIHYPPg 2023-07-13T01:20:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2023-07-13T01:20:06.755 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.oFozIHYPPg is 9KB 2023-07-13T01:20:06.770 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.oFozIHYPPg 2023-07-13T01:20:06.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.833 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:20:06.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-07-13T01:20:06.867 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-76-generic 2023-07-13T01:20:06.867 DEBUG:teuthology.orchestra.run.smithi103:> sudo update-grub 2023-07-13T01:20:06.896 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:06.906 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:06.967 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:06.979 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:07.283 INFO:teuthology.orchestra.run.smithi137.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:07.331 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:07.342 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:07.951 INFO:teuthology.orchestra.run.smithi022.stderr:Sourcing file `/etc/default/grub' 2023-07-13T01:20:07.956 INFO:teuthology.orchestra.run.smithi022.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:07.964 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2023-07-13T01:20:07.968 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2023-07-13T01:20:07.968 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:07.982 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-07-13T01:20:08.073 INFO:teuthology.orchestra.run.smithi137.stderr:done 2023-07-13T01:20:08.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2023-07-13T01:20:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:08.224 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:08.232 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2023-07-13T01:20:08.239 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-13T01:20:08.248 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2023-07-13T01:20:08.268 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:08.280 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:08.501 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.15.0-76-generic 2023-07-13T01:20:08.512 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.15.0-76-generic 2023-07-13T01:20:08.605 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:08.617 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:08.678 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:08.690 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:08.901 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-13T01:20:08.914 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-13T01:20:08.958 INFO:teuthology.orchestra.run.smithi084.stderr:done 2023-07-13T01:20:08.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2023-07-13T01:20:09.796 INFO:teuthology.orchestra.run.smithi022.stderr:done 2023-07-13T01:20:09.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2023-07-13T01:20:10.114 INFO:teuthology.orchestra.run.smithi103.stderr:done 2023-07-13T01:20:10.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2023-07-13T01:20:10.422 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-07-13T01:20:10.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2023-07-13T01:20:38.105 INFO:teuthology.task.kernel:Checking client host.d for new kernel version... 2023-07-13T01:20:38.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-13T01:20:38.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:20:38.964 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2023-07-13T01:20:38.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:20:38.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:20:39.801 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-07-13T01:20:39.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-13T01:20:39.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:20:40.119 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2023-07-13T01:20:40.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:20:40.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:20:40.426 INFO:teuthology.task.kernel:Checking client host.e for new kernel version... 2023-07-13T01:20:40.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:20:40.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:20:56.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-13T01:20:57.456 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-13T01:20:58.224 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-13T01:20:58.480 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-13T01:20:58.992 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-13T01:21:05.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-13T01:21:05.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:06.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:21:06.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:07.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-13T01:21:07.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:07.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:21:07.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:07.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:21:07.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:08.496 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-13T01:21:09.520 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-13T01:21:10.544 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-13T01:21:11.060 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-13T01:21:20.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-13T01:21:20.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:21.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:21:21.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:22.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:21:22.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:23.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:21:23.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:25.616 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-13T01:21:39.952 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-07-13T01:21:40.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:21:40.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:41.488 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-13T01:21:52.313 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-07-13T01:21:52.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-13T01:21:52.862 INFO:teuthology.task.kernel:Checking kernel version of host.d, want "5.15.0-76-generic"... 2023-07-13T01:21:52.863 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2023-07-13T01:21:52.909 INFO:teuthology.orchestra.run.smithi137.stdout:5.15.0-76-generic 2023-07-13T01:21:52.909 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-76-generic vs 5.15.0-76-generic 2023-07-13T01:21:52.910 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T01:21:52.910 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-13T01:21:53.910 INFO:teuthology.task.kernel:Enabling kdb on host.d... 2023-07-13T01:21:53.911 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T01:21:54.259 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2023-07-13T01:21:54.294 DEBUG:teuthology.parallel:result is None 2023-07-13T01:21:54.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:21:54.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:55.350 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-07-13T01:21:56.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:21:56.181 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-76-generic"... 2023-07-13T01:21:56.181 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-07-13T01:21:56.230 INFO:teuthology.orchestra.run.smithi084.stdout:5.15.0-76-generic 2023-07-13T01:21:56.230 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-76-generic vs 5.15.0-76-generic 2023-07-13T01:21:56.230 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T01:21:56.230 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-13T01:21:56.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:21:56.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:21:56.980 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-13T01:21:57.231 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2023-07-13T01:21:57.231 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T01:21:57.306 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2023-07-13T01:21:57.334 DEBUG:teuthology.parallel:result is None 2023-07-13T01:21:57.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:21:57.637 INFO:teuthology.task.kernel:Checking kernel version of host.e, want "5.15.0-76-generic"... 2023-07-13T01:21:57.637 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-07-13T01:21:57.687 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-76-generic 2023-07-13T01:21:57.687 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-76-generic vs 5.15.0-76-generic 2023-07-13T01:21:57.687 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T01:21:57.688 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-13T01:21:58.689 INFO:teuthology.task.kernel:Enabling kdb on host.e... 2023-07-13T01:21:58.689 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T01:21:58.780 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2023-07-13T01:21:58.795 DEBUG:teuthology.parallel:result is None 2023-07-13T01:22:07.228 DEBUG:teuthology.orchestra.remote:timed out 2023-07-13T01:22:12.457 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-07-13T01:22:12.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:22:12.981 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.15.0-76-generic"... 2023-07-13T01:22:12.981 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2023-07-13T01:22:13.028 INFO:teuthology.orchestra.run.smithi103.stdout:5.15.0-76-generic 2023-07-13T01:22:13.029 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-76-generic vs 5.15.0-76-generic 2023-07-13T01:22:13.029 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T01:22:13.029 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-13T01:22:14.030 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2023-07-13T01:22:14.031 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T01:22:14.384 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2023-07-13T01:22:14.412 DEBUG:teuthology.parallel:result is None 2023-07-13T01:22:19.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-13T01:22:19.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:22:19.455 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-07-13T01:22:19.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-13T01:22:19.967 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-76-generic"... 2023-07-13T01:22:19.967 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-07-13T01:22:20.016 INFO:teuthology.orchestra.run.smithi022.stdout:5.15.0-76-generic 2023-07-13T01:22:20.016 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-76-generic vs 5.15.0-76-generic 2023-07-13T01:22:20.016 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-13T01:22:20.017 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-13T01:22:21.018 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-07-13T01:22:21.018 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-13T01:22:21.093 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2023-07-13T01:22:21.116 DEBUG:teuthology.parallel:result is None 2023-07-13T01:22:21.117 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-13T01:22:21.125 INFO:teuthology.task.internal:Creating test directory... 2023-07-13T01:22:21.125 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T01:22:21.128 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T01:22:21.130 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T01:22:21.133 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T01:22:21.135 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-13T01:22:21.143 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-13T01:22:21.157 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-13T01:22:21.165 INFO:teuthology.task.internal:Creating archive directory... 2023-07-13T01:22:21.165 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T01:22:21.174 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T01:22:21.178 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T01:22:21.183 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T01:22:21.185 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-13T01:22:21.291 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-13T01:22:21.298 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-13T01:22:21.299 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T01:22:21.301 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T01:22:21.303 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T01:22:21.305 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T01:22:21.308 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-13T01:22:21.318 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.319 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.324 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.326 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.327 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.332 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.338 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.352 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.361 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-13T01:22:21.363 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-13T01:22:21.369 INFO:teuthology.task.internal:Configuring sudo... 2023-07-13T01:22:21.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T01:22:21.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T01:22:21.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T01:22:21.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T01:22:21.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-13T01:22:21.421 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-13T01:22:21.430 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-13T01:22:21.430 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T01:22:21.442 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T01:22:21.445 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T01:22:21.447 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T01:22:21.449 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-13T01:22:21.471 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T01:22:21.496 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T01:22:21.544 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:22:21.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T01:22:21.603 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T01:22:21.611 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T01:22:21.659 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:22:21.659 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T01:22:21.725 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T01:22:21.733 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T01:22:21.780 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:22:21.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T01:22:21.849 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T01:22:21.856 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T01:22:21.906 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:22:21.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T01:22:21.979 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-13T01:22:21.986 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-13T01:22:22.036 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:22:22.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-13T01:22:22.098 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2023-07-13T01:22:22.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-07-13T01:22:22.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2023-07-13T01:22:22.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2023-07-13T01:22:22.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-07-13T01:22:22.180 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-13T01:22:22.188 INFO:teuthology.task.internal:Starting timer... 2023-07-13T01:22:22.188 INFO:teuthology.run_tasks:Running task pcp... 2023-07-13T01:22:22.200 INFO:teuthology.run_tasks:Running task selinux... 2023-07-13T01:22:22.209 DEBUG:teuthology.task.selinux:Excluding smithi022: OS 'ubuntu' does not support SELinux 2023-07-13T01:22:22.209 DEBUG:teuthology.task.selinux:Excluding smithi084: OS 'ubuntu' does not support SELinux 2023-07-13T01:22:22.209 DEBUG:teuthology.task.selinux:Excluding smithi103: OS 'ubuntu' does not support SELinux 2023-07-13T01:22:22.209 DEBUG:teuthology.task.selinux:Excluding smithi137: OS 'ubuntu' does not support SELinux 2023-07-13T01:22:22.210 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2023-07-13T01:22:22.210 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-13T01:22:22.210 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-13T01:22:22.210 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-13T01:22:22.211 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-13T01:22:22.218 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-13T01:22:22.219 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-13T01:22:22.239 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-13T01:22:22.240 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi084.front.sepia.ceph.com,smithi103.front.sepia.ceph.com,smithi137.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-13T01:28:31.195 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2023-07-13T01:28:31.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-13T01:28:31.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:28:31.286 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-07-13T01:28:31.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-07-13T01:28:31.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:28:31.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:28:31.500 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-07-13T01:28:31.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-07-13T01:28:31.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:28:31.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:28:31.708 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-07-13T01:28:31.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-13T01:28:31.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-13T01:28:31.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:28:31.915 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-07-13T01:28:32.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-13T01:28:32.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:28:32.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:28:32.125 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-13T01:28:32.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-13T01:28:32.247 INFO:teuthology.run_tasks:Running task clock... 2023-07-13T01:28:32.259 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-13T01:28:32.260 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T01:28:32.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T01:28:32.263 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T01:28:32.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T01:28:32.265 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T01:28:32.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T01:28:32.268 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T01:28:32.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T01:28:32.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-13T01:28:32.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T01:28:32.292 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-13T01:28:32.292 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Command line: ntpd -gq 2023-07-13T01:28:32.293 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: proto: precision = 0.105 usec (-23) 2023-07-13T01:28:32.293 INFO:teuthology.orchestra.run.smithi022.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.294 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.294 INFO:teuthology.orchestra.run.smithi022.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.295 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.295 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listen and drop on 0 v6wildcard [::]:123 2023-07-13T01:28:32.295 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-13T01:28:32.295 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listen normally on 2 lo 127.0.0.1:123 2023-07-13T01:28:32.296 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listen normally on 3 ens1f0 172.21.15.22:123 2023-07-13T01:28:32.296 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listen normally on 4 lo [::1]:123 2023-07-13T01:28:32.296 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe59:5de4%4]:123 2023-07-13T01:28:32.296 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:32 ntpd[21978]: Listening on routing socket on fd #22 for interface updates 2023-07-13T01:28:32.296 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-13T01:28:32.297 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Command line: ntpd -gq 2023-07-13T01:28:32.297 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: proto: precision = 0.106 usec (-23) 2023-07-13T01:28:32.298 INFO:teuthology.orchestra.run.smithi084.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.298 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.298 INFO:teuthology.orchestra.run.smithi084.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.299 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.299 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listen and drop on 0 v6wildcard [::]:123 2023-07-13T01:28:32.300 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-13T01:28:32.300 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listen normally on 2 lo 127.0.0.1:123 2023-07-13T01:28:32.300 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listen normally on 3 enp3s0f1 172.21.15.84:123 2023-07-13T01:28:32.300 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listen normally on 4 lo [::1]:123 2023-07-13T01:28:32.300 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d751%5]:123 2023-07-13T01:28:32.300 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:32 ntpd[22101]: Listening on routing socket on fd #22 for interface updates 2023-07-13T01:28:32.301 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-13T01:28:32.301 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Command line: ntpd -gq 2023-07-13T01:28:32.301 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: proto: precision = 0.059 usec (-24) 2023-07-13T01:28:32.301 INFO:teuthology.orchestra.run.smithi103.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.302 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.302 INFO:teuthology.orchestra.run.smithi103.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.303 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.303 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listen and drop on 0 v6wildcard [::]:123 2023-07-13T01:28:32.303 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-13T01:28:32.303 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listen normally on 2 lo 127.0.0.1:123 2023-07-13T01:28:32.304 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listen normally on 3 enp3s0f1 172.21.15.103:123 2023-07-13T01:28:32.304 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listen normally on 4 lo [::1]:123 2023-07-13T01:28:32.304 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0b%5]:123 2023-07-13T01:28:32.304 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:32 ntpd[22130]: Listening on routing socket on fd #22 for interface updates 2023-07-13T01:28:32.305 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-13T01:28:32.305 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Command line: ntpd -gq 2023-07-13T01:28:32.305 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: proto: precision = 0.088 usec (-23) 2023-07-13T01:28:32.305 INFO:teuthology.orchestra.run.smithi137.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.306 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.306 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.306 INFO:teuthology.orchestra.run.smithi137.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.307 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listen and drop on 0 v6wildcard [::]:123 2023-07-13T01:28:32.307 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-13T01:28:32.307 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listen normally on 2 lo 127.0.0.1:123 2023-07-13T01:28:32.308 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listen normally on 3 enp3s0f1 172.21.15.137:123 2023-07-13T01:28:32.308 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listen normally on 4 lo [::1]:123 2023-07-13T01:28:32.308 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8137%5]:123 2023-07-13T01:28:32.308 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:32 ntpd[22094]: Listening on routing socket on fd #22 for interface updates 2023-07-13T01:28:32.323 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-13T01:28:32.324 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Command line: ntpd -gq 2023-07-13T01:28:32.324 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: proto: precision = 0.082 usec (-23) 2023-07-13T01:28:32.325 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.325 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-13T01:28:32.325 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.326 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: restrict ::: KOD does nothing without LIMITED. 2023-07-13T01:28:32.326 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listen and drop on 0 v6wildcard [::]:123 2023-07-13T01:28:32.326 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-13T01:28:32.327 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listen normally on 2 lo 127.0.0.1:123 2023-07-13T01:28:32.327 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2023-07-13T01:28:32.327 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listen normally on 4 lo [::1]:123 2023-07-13T01:28:32.327 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2023-07-13T01:28:32.327 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:32 ntpd[22099]: Listening on routing socket on fd #22 for interface updates 2023-07-13T01:28:33.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:33 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:33.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:33 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:33 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:33 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:33 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:33 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:33 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:33.298 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.299 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:33 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:33.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:33 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:33 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:33 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:33.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:33 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:33.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:33 ntpd[22099]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:33.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:33 ntpd[22099]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:34.303 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:34 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:34.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:34 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.298 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.298 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.298 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:35 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.300 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:35 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:35 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:35 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:35.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:35.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:35 ntpd[22099]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:36.292 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:36 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:36.292 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:36 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:36 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:36 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:36 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:36 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:36 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:36.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:36 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:37 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:37 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.301 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.302 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.303 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:37 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:37 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:37.327 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:37 ntpd[22099]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:38 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:38 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:38 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:38 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:38 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:38 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.294 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.295 INFO:teuthology.orchestra.run.smithi022.stdout:13 Jul 01:28:39 ntpd[21978]: ntpd: time slew +0.002617 s 2023-07-13T01:28:39.295 INFO:teuthology.orchestra.run.smithi022.stdout:ntpd: time slew +0.002617s 2023-07-13T01:28:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-13T01:28:39.297 INFO:teuthology.orchestra.run.smithi022.stderr:13 Jul 01:28:39 ntpd[21978]: can't open /var/log/ntpstats/loopstats.20230713: Permission denied 2023-07-13T01:28:39.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.299 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.300 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.300 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.300 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.301 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.301 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.301 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.302 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.303 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.303 INFO:teuthology.orchestra.run.smithi084.stdout:13 Jul 01:28:39 ntpd[22101]: ntpd: time slew +0.000522 s 2023-07-13T01:28:39.304 INFO:teuthology.orchestra.run.smithi084.stdout:ntpd: time slew +0.000522s 2023-07-13T01:28:39.304 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-13T01:28:39.305 INFO:teuthology.orchestra.run.smithi084.stderr:13 Jul 01:28:39 ntpd[22101]: can't open /var/log/ntpstats/loopstats.20230713: Permission denied 2023-07-13T01:28:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.308 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:39 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.309 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.310 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.311 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.311 INFO:teuthology.orchestra.run.smithi103.stdout:13 Jul 01:28:39 ntpd[22130]: ntpd: time slew +0.000060 s 2023-07-13T01:28:39.311 INFO:teuthology.orchestra.run.smithi103.stdout:ntpd: time slew +0.000060s 2023-07-13T01:28:39.311 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-13T01:28:39.312 INFO:teuthology.orchestra.run.smithi103.stderr:13 Jul 01:28:39 ntpd[22130]: can't open /var/log/ntpstats/loopstats.20230713: Permission denied 2023-07-13T01:28:39.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.324 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.325 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:39.326 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:39.327 INFO:teuthology.orchestra.run.smithi154.stdout:13 Jul 01:28:39 ntpd[22099]: ntpd: time slew +0.000172 s 2023-07-13T01:28:39.327 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew +0.000172s 2023-07-13T01:28:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-13T01:28:39.327 INFO:teuthology.orchestra.run.smithi154.stderr:13 Jul 01:28:39 ntpd[22099]: can't open /var/log/ntpstats/loopstats.20230713: Permission denied 2023-07-13T01:28:39.347 INFO:teuthology.orchestra.run.smithi022.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T01:28:39.347 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================== 2023-07-13T01:28:39.347 INFO:teuthology.orchestra.run.smithi022.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.347 INFO:teuthology.orchestra.run.smithi022.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.348 INFO:teuthology.orchestra.run.smithi022.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.348 INFO:teuthology.orchestra.run.smithi022.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.356 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T01:28:39.356 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2023-07-13T01:28:39.356 INFO:teuthology.orchestra.run.smithi103.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.356 INFO:teuthology.orchestra.run.smithi103.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.357 INFO:teuthology.orchestra.run.smithi103.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.357 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.384 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T01:28:39.385 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2023-07-13T01:28:39.385 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.385 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.385 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.386 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.437 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T01:28:39.437 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2023-07-13T01:28:39.437 INFO:teuthology.orchestra.run.smithi084.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.437 INFO:teuthology.orchestra.run.smithi084.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.438 INFO:teuthology.orchestra.run.smithi084.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:39.438 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:40.303 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:40 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:40.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:40 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:40.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:40 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:40.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:40 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:40.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:40 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:40.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:40 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:41.303 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:41.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:41.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:41.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:41.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-13T01:28:41.304 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: can't open /var/log/ntpstats/rawstats.20230713: Permission denied 2023-07-13T01:28:41.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-13T01:28:41.305 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: can't open /var/log/ntpstats/peerstats.20230713: Permission denied 2023-07-13T01:28:41.305 INFO:teuthology.orchestra.run.smithi137.stdout:13 Jul 01:28:41 ntpd[22094]: ntpd: time slew +0.000770 s 2023-07-13T01:28:41.305 INFO:teuthology.orchestra.run.smithi137.stdout:ntpd: time slew +0.000770s 2023-07-13T01:28:41.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-13T01:28:41.306 INFO:teuthology.orchestra.run.smithi137.stderr:13 Jul 01:28:41 ntpd[22094]: can't open /var/log/ntpstats/loopstats.20230713: Permission denied 2023-07-13T01:28:41.367 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T01:28:41.367 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2023-07-13T01:28:41.367 INFO:teuthology.orchestra.run.smithi137.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:41.367 INFO:teuthology.orchestra.run.smithi137.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:41.367 INFO:teuthology.orchestra.run.smithi137.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:41.367 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-13T01:28:41.368 INFO:teuthology.run_tasks:Running task install... 2023-07-13T01:28:41.377 DEBUG:teuthology.task.install:project ceph 2023-07-13T01:28:41.377 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3990f91ac125621431ef1b77c2fc96421bec9e51'}} 2023-07-13T01:28:41.378 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3990f91ac125621431ef1b77c2fc96421bec9e51'} 2023-07-13T01:28:41.378 INFO:teuthology.task.install:Using flavor: default 2023-07-13T01:28:41.383 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-13T01:28:41.383 INFO:teuthology.task.install:extra packages: [] 2023-07-13T01:28:41.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-key list | grep Ceph 2023-07-13T01:28:41.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-key list | grep Ceph 2023-07-13T01:28:41.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-key list | grep Ceph 2023-07-13T01:28:41.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-key list | grep Ceph 2023-07-13T01:28:41.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2023-07-13T01:28:41.487 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-13T01:28:41.488 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-13T01:28:41.490 INFO:teuthology.orchestra.run.smithi022.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-13T01:28:41.491 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-13T01:28:41.500 INFO:teuthology.orchestra.run.smithi137.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-13T01:28:41.543 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-13T01:28:41.544 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph.com (release key) 2023-07-13T01:28:41.544 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-07-13T01:28:41.545 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:28:41.548 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-13T01:28:41.549 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2023-07-13T01:28:41.549 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-07-13T01:28:41.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:28:41.552 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-13T01:28:41.552 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph.com (release key) 2023-07-13T01:28:41.553 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-07-13T01:28:41.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:28:41.556 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-13T01:28:41.557 INFO:teuthology.orchestra.run.smithi137.stdout:uid [ unknown] Ceph.com (release key) 2023-07-13T01:28:41.557 INFO:teuthology.orchestra.run.smithi022.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-13T01:28:41.557 INFO:teuthology.orchestra.run.smithi022.stdout:uid [ unknown] Ceph.com (release key) 2023-07-13T01:28:41.557 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-07-13T01:28:41.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:28:41.559 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-07-13T01:28:41.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:28:41.787 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/ 2023-07-13T01:28:41.787 INFO:teuthology.task.install.deb:Package version is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:41.792 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/ 2023-07-13T01:28:41.792 INFO:teuthology.task.install.deb:Package version is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:41.801 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/ 2023-07-13T01:28:41.801 INFO:teuthology.task.install.deb:Package version is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:41.810 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/ 2023-07-13T01:28:41.811 INFO:teuthology.task.install.deb:Package version is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:41.814 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/ 2023-07-13T01:28:41.814 INFO:teuthology.task.install.deb:Package version is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:41.977 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:28:41.978 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-13T01:28:41.986 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:28:41.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-13T01:28:41.993 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:28:41.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-13T01:28:41.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2023-07-13T01:28:42.002 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:28:42.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-13T01:28:42.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2023-07-13T01:28:42.014 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:28:42.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-13T01:28:42.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo apt-get update 2023-07-13T01:28:42.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2023-07-13T01:28:42.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2023-07-13T01:28:42.220 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:28:42.225 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:28:42.304 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal InRelease 2023-07-13T01:28:42.323 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal InRelease 2023-07-13T01:28:42.326 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal InRelease 2023-07-13T01:28:42.340 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal InRelease 2023-07-13T01:28:42.341 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:28:42.342 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:28:42.344 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:28:42.345 INFO:teuthology.orchestra.run.smithi022.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal InRelease 2023-07-13T01:28:42.350 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:28:42.351 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:28:42.351 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:28:42.354 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-13T01:28:42.354 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-07-13T01:28:42.355 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-13T01:28:42.361 INFO:teuthology.orchestra.run.smithi137.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:28:42.367 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-13T01:28:42.369 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-13T01:28:42.381 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-13T01:28:42.395 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-13T01:28:42.402 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:28:42.406 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release.gpg 2023-07-13T01:28:42.422 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release.gpg 2023-07-13T01:28:42.423 INFO:teuthology.orchestra.run.smithi137.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release.gpg 2023-07-13T01:28:42.430 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release.gpg 2023-07-13T01:28:42.432 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:28:42.433 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:28:42.438 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-07-13T01:28:42.444 INFO:teuthology.orchestra.run.smithi022.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal Release.gpg 2023-07-13T01:28:42.446 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-13T01:28:42.455 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-13T01:28:42.478 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main i386 Packages [3,416 B] 2023-07-13T01:28:42.486 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-13T01:28:42.486 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main i386 Packages [3,416 B] 2023-07-13T01:28:42.495 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-13T01:28:42.534 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:28:42.535 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main i386 Packages [3,416 B] 2023-07-13T01:28:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:28:42.552 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main i386 Packages [3,416 B] 2023-07-13T01:28:42.553 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-13T01:28:42.557 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-07-13T01:28:42.558 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main i386 Packages [3,416 B] 2023-07-13T01:28:42.850 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:28:42.872 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-07-13T01:28:42.967 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 251 kB in 1s (336 kB/s) 2023-07-13T01:28:43.031 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:28:43.051 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:28:43.088 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 251 kB in 1s (292 kB/s) 2023-07-13T01:28:43.100 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 251 kB in 1s (291 kB/s) 2023-07-13T01:28:43.464 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,686 kB] 2023-07-13T01:28:43.551 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [851 kB] 2023-07-13T01:28:43.590 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:28:43.633 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:28:43.673 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,083 kB] 2023-07-13T01:28:43.711 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [735 kB] 2023-07-13T01:28:44.008 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2023-07-13T01:28:44.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4093-g3990f91a-1focal cephadm=18.0.0-4093-g3990f91a-1focal ceph-mds=18.0.0-4093-g3990f91a-1focal ceph-mgr=18.0.0-4093-g3990f91a-1focal ceph-common=18.0.0-4093-g3990f91a-1focal ceph-fuse=18.0.0-4093-g3990f91a-1focal ceph-test=18.0.0-4093-g3990f91a-1focal ceph-volume=18.0.0-4093-g3990f91a-1focal radosgw=18.0.0-4093-g3990f91a-1focal python3-rados=18.0.0-4093-g3990f91a-1focal python3-rgw=18.0.0-4093-g3990f91a-1focal python3-cephfs=18.0.0-4093-g3990f91a-1focal python3-rbd=18.0.0-4093-g3990f91a-1focal libcephfs2=18.0.0-4093-g3990f91a-1focal libcephfs-dev=18.0.0-4093-g3990f91a-1focal librados2=18.0.0-4093-g3990f91a-1focal librbd1=18.0.0-4093-g3990f91a-1focal rbd-fuse=18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:44.108 INFO:teuthology.orchestra.run.smithi137.stdout:Reading package lists... 2023-07-13T01:28:44.112 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-13T01:28:44.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4093-g3990f91a-1focal cephadm=18.0.0-4093-g3990f91a-1focal ceph-mds=18.0.0-4093-g3990f91a-1focal ceph-mgr=18.0.0-4093-g3990f91a-1focal ceph-common=18.0.0-4093-g3990f91a-1focal ceph-fuse=18.0.0-4093-g3990f91a-1focal ceph-test=18.0.0-4093-g3990f91a-1focal ceph-volume=18.0.0-4093-g3990f91a-1focal radosgw=18.0.0-4093-g3990f91a-1focal python3-rados=18.0.0-4093-g3990f91a-1focal python3-rgw=18.0.0-4093-g3990f91a-1focal python3-cephfs=18.0.0-4093-g3990f91a-1focal python3-rbd=18.0.0-4093-g3990f91a-1focal libcephfs2=18.0.0-4093-g3990f91a-1focal libcephfs-dev=18.0.0-4093-g3990f91a-1focal librados2=18.0.0-4093-g3990f91a-1focal librbd1=18.0.0-4093-g3990f91a-1focal rbd-fuse=18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:44.152 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2023-07-13T01:28:44.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4093-g3990f91a-1focal cephadm=18.0.0-4093-g3990f91a-1focal ceph-mds=18.0.0-4093-g3990f91a-1focal ceph-mgr=18.0.0-4093-g3990f91a-1focal ceph-common=18.0.0-4093-g3990f91a-1focal ceph-fuse=18.0.0-4093-g3990f91a-1focal ceph-test=18.0.0-4093-g3990f91a-1focal ceph-volume=18.0.0-4093-g3990f91a-1focal radosgw=18.0.0-4093-g3990f91a-1focal python3-rados=18.0.0-4093-g3990f91a-1focal python3-rgw=18.0.0-4093-g3990f91a-1focal python3-cephfs=18.0.0-4093-g3990f91a-1focal python3-rbd=18.0.0-4093-g3990f91a-1focal libcephfs2=18.0.0-4093-g3990f91a-1focal libcephfs-dev=18.0.0-4093-g3990f91a-1focal librados2=18.0.0-4093-g3990f91a-1focal librbd1=18.0.0-4093-g3990f91a-1focal rbd-fuse=18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:44.210 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-13T01:28:44.211 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 5,719 kB in 2s (2,838 kB/s) 2023-07-13T01:28:44.244 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 5,719 kB in 2s (2,806 kB/s) 2023-07-13T01:28:44.252 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2023-07-13T01:28:44.303 INFO:teuthology.orchestra.run.smithi137.stdout:Building dependency tree... 2023-07-13T01:28:44.304 INFO:teuthology.orchestra.run.smithi137.stdout:Reading state information... 2023-07-13T01:28:44.384 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2023-07-13T01:28:44.385 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2023-07-13T01:28:44.434 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2023-07-13T01:28:44.434 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2023-07-13T01:28:44.483 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages were automatically installed and are no longer required: 2023-07-13T01:28:44.483 INFO:teuthology.orchestra.run.smithi137.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-13T01:28:44.484 INFO:teuthology.orchestra.run.smithi137.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-13T01:28:44.484 INFO:teuthology.orchestra.run.smithi137.stdout:The following additional packages will be installed: 2023-07-13T01:28:44.484 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-13T01:28:44.485 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-13T01:28:44.485 INFO:teuthology.orchestra.run.smithi137.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-13T01:28:44.485 INFO:teuthology.orchestra.run.smithi137.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-13T01:28:44.485 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-13T01:28:44.485 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-13T01:28:44.485 INFO:teuthology.orchestra.run.smithi137.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:44.486 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-13T01:28:44.487 INFO:teuthology.orchestra.run.smithi137.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-13T01:28:44.488 INFO:teuthology.orchestra.run.smithi137.stdout:Suggested packages: 2023-07-13T01:28:44.488 INFO:teuthology.orchestra.run.smithi137.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-13T01:28:44.488 INFO:teuthology.orchestra.run.smithi137.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-13T01:28:44.488 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-13T01:28:44.488 INFO:teuthology.orchestra.run.smithi137.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-13T01:28:44.488 INFO:teuthology.orchestra.run.smithi137.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-13T01:28:44.489 INFO:teuthology.orchestra.run.smithi137.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-13T01:28:44.489 INFO:teuthology.orchestra.run.smithi137.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-13T01:28:44.489 INFO:teuthology.orchestra.run.smithi137.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-13T01:28:44.489 INFO:teuthology.orchestra.run.smithi137.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-13T01:28:44.489 INFO:teuthology.orchestra.run.smithi137.stdout:Recommended packages: 2023-07-13T01:28:44.489 INFO:teuthology.orchestra.run.smithi137.stdout: btrfs-tools 2023-07-13T01:28:44.547 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2023-07-13T01:28:44.548 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-13T01:28:44.549 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-13T01:28:44.549 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2023-07-13T01:28:44.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-13T01:28:44.549 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-13T01:28:44.550 INFO:teuthology.orchestra.run.smithi103.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-13T01:28:44.550 INFO:teuthology.orchestra.run.smithi103.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-13T01:28:44.550 INFO:teuthology.orchestra.run.smithi103.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-13T01:28:44.550 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-13T01:28:44.550 INFO:teuthology.orchestra.run.smithi103.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-13T01:28:44.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:44.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:44.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-13T01:28:44.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-13T01:28:44.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-13T01:28:44.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-13T01:28:44.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-13T01:28:44.552 INFO:teuthology.orchestra.run.smithi103.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-13T01:28:44.553 INFO:teuthology.orchestra.run.smithi103.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-13T01:28:44.554 INFO:teuthology.orchestra.run.smithi103.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-13T01:28:44.554 INFO:teuthology.orchestra.run.smithi103.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-13T01:28:44.554 INFO:teuthology.orchestra.run.smithi103.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-13T01:28:44.554 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2023-07-13T01:28:44.554 INFO:teuthology.orchestra.run.smithi103.stdout: btrfs-tools 2023-07-13T01:28:44.608 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages were automatically installed and are no longer required: 2023-07-13T01:28:44.609 INFO:teuthology.orchestra.run.smithi022.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-13T01:28:44.609 INFO:teuthology.orchestra.run.smithi022.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-13T01:28:44.609 INFO:teuthology.orchestra.run.smithi022.stdout:The following additional packages will be installed: 2023-07-13T01:28:44.610 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-13T01:28:44.610 INFO:teuthology.orchestra.run.smithi137.stdout:The following NEW packages will be installed: 2023-07-13T01:28:44.610 INFO:teuthology.orchestra.run.smithi137.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-13T01:28:44.610 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-13T01:28:44.611 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-13T01:28:44.611 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-13T01:28:44.611 INFO:teuthology.orchestra.run.smithi022.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-13T01:28:44.612 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-13T01:28:44.613 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-13T01:28:44.614 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-13T01:28:44.614 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-13T01:28:44.614 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-13T01:28:44.614 INFO:teuthology.orchestra.run.smithi022.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout:Suggested packages: 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-13T01:28:44.615 INFO:teuthology.orchestra.run.smithi022.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-13T01:28:44.616 INFO:teuthology.orchestra.run.smithi022.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-13T01:28:44.616 INFO:teuthology.orchestra.run.smithi022.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-13T01:28:44.616 INFO:teuthology.orchestra.run.smithi022.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-13T01:28:44.616 INFO:teuthology.orchestra.run.smithi022.stdout:Recommended packages: 2023-07-13T01:28:44.616 INFO:teuthology.orchestra.run.smithi022.stdout: btrfs-tools 2023-07-13T01:28:44.617 INFO:teuthology.orchestra.run.smithi137.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-07-13T01:28:44.617 INFO:teuthology.orchestra.run.smithi137.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-07-13T01:28:44.617 INFO:teuthology.orchestra.run.smithi137.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-07-13T01:28:44.617 INFO:teuthology.orchestra.run.smithi137.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:44.618 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-07-13T01:28:44.619 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-07-13T01:28:44.620 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-07-13T01:28:44.620 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet 2023-07-13T01:28:44.620 INFO:teuthology.orchestra.run.smithi137.stdout:The following packages will be upgraded: 2023-07-13T01:28:44.620 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 librbd1 2023-07-13T01:28:44.665 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2023-07-13T01:28:44.665 INFO:teuthology.orchestra.run.smithi103.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-13T01:28:44.665 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-13T01:28:44.665 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-13T01:28:44.666 INFO:teuthology.orchestra.run.smithi103.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-07-13T01:28:44.666 INFO:teuthology.orchestra.run.smithi103.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-07-13T01:28:44.666 INFO:teuthology.orchestra.run.smithi103.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-13T01:28:44.667 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-07-13T01:28:44.668 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-13T01:28:44.669 INFO:teuthology.orchestra.run.smithi103.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-07-13T01:28:44.669 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-07-13T01:28:44.669 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-07-13T01:28:44.669 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet 2023-07-13T01:28:44.669 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2023-07-13T01:28:44.670 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 librbd1 2023-07-13T01:28:44.734 INFO:teuthology.orchestra.run.smithi022.stdout:The following NEW packages will be installed: 2023-07-13T01:28:44.734 INFO:teuthology.orchestra.run.smithi022.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-13T01:28:44.734 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-13T01:28:44.734 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-13T01:28:44.735 INFO:teuthology.orchestra.run.smithi022.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-07-13T01:28:44.735 INFO:teuthology.orchestra.run.smithi022.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-07-13T01:28:44.735 INFO:teuthology.orchestra.run.smithi022.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-07-13T01:28:44.736 INFO:teuthology.orchestra.run.smithi022.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-07-13T01:28:44.737 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-13T01:28:44.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-07-13T01:28:44.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-07-13T01:28:44.738 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-07-13T01:28:44.738 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet 2023-07-13T01:28:44.738 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages will be upgraded: 2023-07-13T01:28:44.739 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 librbd1 2023-07-13T01:28:44.814 INFO:teuthology.orchestra.run.smithi022.stdout:2 upgraded, 110 newly installed, 0 to remove and 210 not upgraded. 2023-07-13T01:28:44.815 INFO:teuthology.orchestra.run.smithi022.stdout:Need to get 201 MB of archives. 2023-07-13T01:28:44.815 INFO:teuthology.orchestra.run.smithi022.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-07-13T01:28:44.815 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-13T01:28:44.817 INFO:teuthology.orchestra.run.smithi137.stdout:2 upgraded, 110 newly installed, 0 to remove and 210 not upgraded. 2023-07-13T01:28:44.817 INFO:teuthology.orchestra.run.smithi137.stdout:Need to get 201 MB of archives. 2023-07-13T01:28:44.817 INFO:teuthology.orchestra.run.smithi137.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-07-13T01:28:44.817 INFO:teuthology.orchestra.run.smithi137.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-13T01:28:44.848 INFO:teuthology.orchestra.run.smithi137.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4093-g3990f91a-1focal [3,432 kB] 2023-07-13T01:28:44.872 INFO:teuthology.orchestra.run.smithi103.stdout:2 upgraded, 110 newly installed, 0 to remove and 210 not upgraded. 2023-07-13T01:28:44.872 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 201 MB of archives. 2023-07-13T01:28:44.872 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-07-13T01:28:44.872 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-13T01:28:44.904 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4093-g3990f91a-1focal [3,432 kB] 2023-07-13T01:28:44.930 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-13T01:28:44.934 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-13T01:28:44.961 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-13T01:28:44.971 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4093-g3990f91a-1focal [3,432 kB] 2023-07-13T01:28:45.056 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-13T01:28:45.060 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-13T01:28:45.080 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-13T01:28:45.083 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-13T01:28:45.083 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-13T01:28:45.086 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-13T01:28:45.086 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-13T01:28:45.145 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-13T01:28:45.198 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-07-13T01:28:45.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4093-g3990f91a-1focal cephadm=18.0.0-4093-g3990f91a-1focal ceph-mds=18.0.0-4093-g3990f91a-1focal ceph-mgr=18.0.0-4093-g3990f91a-1focal ceph-common=18.0.0-4093-g3990f91a-1focal ceph-fuse=18.0.0-4093-g3990f91a-1focal ceph-test=18.0.0-4093-g3990f91a-1focal ceph-volume=18.0.0-4093-g3990f91a-1focal radosgw=18.0.0-4093-g3990f91a-1focal python3-rados=18.0.0-4093-g3990f91a-1focal python3-rgw=18.0.0-4093-g3990f91a-1focal python3-cephfs=18.0.0-4093-g3990f91a-1focal python3-rbd=18.0.0-4093-g3990f91a-1focal libcephfs2=18.0.0-4093-g3990f91a-1focal libcephfs-dev=18.0.0-4093-g3990f91a-1focal librados2=18.0.0-4093-g3990f91a-1focal librbd1=18.0.0-4093-g3990f91a-1focal rbd-fuse=18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:45.234 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-13T01:28:45.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4093-g3990f91a-1focal cephadm=18.0.0-4093-g3990f91a-1focal ceph-mds=18.0.0-4093-g3990f91a-1focal ceph-mgr=18.0.0-4093-g3990f91a-1focal ceph-common=18.0.0-4093-g3990f91a-1focal ceph-fuse=18.0.0-4093-g3990f91a-1focal ceph-test=18.0.0-4093-g3990f91a-1focal ceph-volume=18.0.0-4093-g3990f91a-1focal radosgw=18.0.0-4093-g3990f91a-1focal python3-rados=18.0.0-4093-g3990f91a-1focal python3-rgw=18.0.0-4093-g3990f91a-1focal python3-cephfs=18.0.0-4093-g3990f91a-1focal python3-rbd=18.0.0-4093-g3990f91a-1focal libcephfs2=18.0.0-4093-g3990f91a-1focal libcephfs-dev=18.0.0-4093-g3990f91a-1focal librados2=18.0.0-4093-g3990f91a-1focal librbd1=18.0.0-4093-g3990f91a-1focal rbd-fuse=18.0.0-4093-g3990f91a-1focal 2023-07-13T01:28:45.271 INFO:teuthology.orchestra.run.smithi137.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-13T01:28:45.271 INFO:teuthology.orchestra.run.smithi022.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-13T01:28:45.293 INFO:teuthology.orchestra.run.smithi137.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-13T01:28:45.298 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-07-13T01:28:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2023-07-13T01:28:45.329 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-13T01:28:45.345 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-13T01:28:45.350 INFO:teuthology.orchestra.run.smithi022.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-13T01:28:45.358 INFO:teuthology.orchestra.run.smithi022.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-13T01:28:45.360 INFO:teuthology.orchestra.run.smithi022.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-13T01:28:45.367 INFO:teuthology.orchestra.run.smithi022.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-13T01:28:45.377 INFO:teuthology.orchestra.run.smithi137.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-13T01:28:45.379 INFO:teuthology.orchestra.run.smithi022.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-13T01:28:45.382 INFO:teuthology.orchestra.run.smithi022.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-13T01:28:45.383 INFO:teuthology.orchestra.run.smithi022.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-13T01:28:45.392 INFO:teuthology.orchestra.run.smithi022.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-13T01:28:45.394 INFO:teuthology.orchestra.run.smithi022.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-13T01:28:45.448 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-13T01:28:45.470 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-07-13T01:28:45.471 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-07-13T01:28:45.503 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2023-07-13T01:28:45.503 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2023-07-13T01:28:45.633 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2023-07-13T01:28:45.634 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-13T01:28:45.634 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-13T01:28:45.634 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2023-07-13T01:28:45.634 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-13T01:28:45.634 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-13T01:28:45.634 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-13T01:28:45.635 INFO:teuthology.orchestra.run.smithi084.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-13T01:28:45.635 INFO:teuthology.orchestra.run.smithi084.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-13T01:28:45.635 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-13T01:28:45.635 INFO:teuthology.orchestra.run.smithi084.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:45.636 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-13T01:28:45.637 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-13T01:28:45.638 INFO:teuthology.orchestra.run.smithi084.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-13T01:28:45.638 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2023-07-13T01:28:45.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-13T01:28:45.638 INFO:teuthology.orchestra.run.smithi084.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-13T01:28:45.638 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2023-07-13T01:28:45.639 INFO:teuthology.orchestra.run.smithi084.stdout: btrfs-tools 2023-07-13T01:28:45.664 INFO:teuthology.orchestra.run.smithi022.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-13T01:28:45.666 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2023-07-13T01:28:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-13T01:28:45.667 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-13T01:28:45.668 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2023-07-13T01:28:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-13T01:28:45.668 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-13T01:28:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-13T01:28:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-13T01:28:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-13T01:28:45.669 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:45.670 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-13T01:28:45.671 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-13T01:28:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-13T01:28:45.672 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2023-07-13T01:28:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-13T01:28:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-13T01:28:45.672 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-13T01:28:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-13T01:28:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-13T01:28:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-13T01:28:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-13T01:28:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-13T01:28:45.673 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-13T01:28:45.674 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2023-07-13T01:28:45.674 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2023-07-13T01:28:45.703 INFO:teuthology.orchestra.run.smithi137.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-13T01:28:45.717 INFO:teuthology.orchestra.run.smithi137.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-13T01:28:45.752 INFO:teuthology.orchestra.run.smithi137.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-13T01:28:45.759 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2023-07-13T01:28:45.759 INFO:teuthology.orchestra.run.smithi084.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-13T01:28:45.759 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-13T01:28:45.759 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-13T01:28:45.759 INFO:teuthology.orchestra.run.smithi084.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-07-13T01:28:45.760 INFO:teuthology.orchestra.run.smithi084.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-07-13T01:28:45.760 INFO:teuthology.orchestra.run.smithi084.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-07-13T01:28:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-07-13T01:28:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-07-13T01:28:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-07-13T01:28:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-07-13T01:28:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-13T01:28:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-07-13T01:28:45.762 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-07-13T01:28:45.763 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-13T01:28:45.763 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-07-13T01:28:45.763 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-07-13T01:28:45.763 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-07-13T01:28:45.763 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet 2023-07-13T01:28:45.763 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2023-07-13T01:28:45.764 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 librbd1 2023-07-13T01:28:45.764 INFO:teuthology.orchestra.run.smithi137.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-13T01:28:45.764 INFO:teuthology.orchestra.run.smithi137.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-13T01:28:45.765 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-13T01:28:45.766 INFO:teuthology.orchestra.run.smithi137.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-13T01:28:45.767 INFO:teuthology.orchestra.run.smithi137.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-13T01:28:45.782 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-13T01:28:45.786 INFO:teuthology.orchestra.run.smithi022.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-13T01:28:45.788 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2023-07-13T01:28:45.788 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-13T01:28:45.789 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-13T01:28:45.789 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-13T01:28:45.790 INFO:teuthology.orchestra.run.smithi154.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-07-13T01:28:45.790 INFO:teuthology.orchestra.run.smithi154.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-07-13T01:28:45.790 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-07-13T01:28:45.790 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-07-13T01:28:45.790 INFO:teuthology.orchestra.run.smithi154.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2023-07-13T01:28:45.790 INFO:teuthology.orchestra.run.smithi154.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-13T01:28:45.791 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2023-07-13T01:28:45.792 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet 2023-07-13T01:28:45.793 INFO:teuthology.orchestra.run.smithi022.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-13T01:28:45.793 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2023-07-13T01:28:45.794 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 librbd1 2023-07-13T01:28:45.814 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-13T01:28:45.821 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-13T01:28:45.821 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-13T01:28:45.826 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-13T01:28:45.827 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-13T01:28:45.877 INFO:teuthology.orchestra.run.smithi022.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-13T01:28:45.878 INFO:teuthology.orchestra.run.smithi022.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-13T01:28:45.878 INFO:teuthology.orchestra.run.smithi154.stdout:2 upgraded, 110 newly installed, 0 to remove and 210 not upgraded. 2023-07-13T01:28:45.878 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 201 MB of archives. 2023-07-13T01:28:45.879 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-07-13T01:28:45.879 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-13T01:28:45.879 INFO:teuthology.orchestra.run.smithi022.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-13T01:28:45.882 INFO:teuthology.orchestra.run.smithi022.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-13T01:28:45.887 INFO:teuthology.orchestra.run.smithi022.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-13T01:28:45.899 INFO:teuthology.orchestra.run.smithi022.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-13T01:28:45.910 INFO:teuthology.orchestra.run.smithi022.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-13T01:28:45.914 INFO:teuthology.orchestra.run.smithi022.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-13T01:28:45.972 INFO:teuthology.orchestra.run.smithi084.stdout:2 upgraded, 110 newly installed, 0 to remove and 210 not upgraded. 2023-07-13T01:28:45.972 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 201 MB of archives. 2023-07-13T01:28:45.972 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 1,003 MB of additional disk space will be used. 2023-07-13T01:28:45.972 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-13T01:28:45.973 INFO:teuthology.orchestra.run.smithi137.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-13T01:28:45.989 INFO:teuthology.orchestra.run.smithi022.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-13T01:28:46.009 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4093-g3990f91a-1focal [3,432 kB] 2023-07-13T01:28:46.029 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-13T01:28:46.044 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-13T01:28:46.052 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4093-g3990f91a-1focal [3,432 kB] 2023-07-13T01:28:46.081 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-13T01:28:46.113 INFO:teuthology.orchestra.run.smithi022.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-13T01:28:46.119 INFO:teuthology.orchestra.run.smithi022.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-13T01:28:46.121 INFO:teuthology.orchestra.run.smithi022.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-13T01:28:46.123 INFO:teuthology.orchestra.run.smithi022.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-13T01:28:46.161 INFO:teuthology.orchestra.run.smithi022.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-13T01:28:46.164 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-13T01:28:46.194 INFO:teuthology.orchestra.run.smithi022.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-13T01:28:46.201 INFO:teuthology.orchestra.run.smithi022.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-13T01:28:46.202 INFO:teuthology.orchestra.run.smithi022.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-13T01:28:46.209 INFO:teuthology.orchestra.run.smithi022.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-13T01:28:46.209 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-13T01:28:46.218 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-13T01:28:46.237 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-13T01:28:46.246 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-13T01:28:46.246 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-13T01:28:46.248 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-13T01:28:46.249 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-13T01:28:46.265 INFO:teuthology.orchestra.run.smithi137.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-13T01:28:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-13T01:28:46.458 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-13T01:28:46.460 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-13T01:28:46.479 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-13T01:28:46.484 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-13T01:28:46.490 INFO:teuthology.orchestra.run.smithi137.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-13T01:28:46.509 INFO:teuthology.orchestra.run.smithi137.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-13T01:28:46.520 INFO:teuthology.orchestra.run.smithi137.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-13T01:28:46.534 INFO:teuthology.orchestra.run.smithi022.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-13T01:28:46.542 INFO:teuthology.orchestra.run.smithi137.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-13T01:28:46.568 INFO:teuthology.orchestra.run.smithi137.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-13T01:28:46.572 INFO:teuthology.orchestra.run.smithi137.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-13T01:28:46.574 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-13T01:28:46.580 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-13T01:28:46.580 INFO:teuthology.orchestra.run.smithi137.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-13T01:28:46.584 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-13T01:28:46.585 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-13T01:28:46.600 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-13T01:28:46.606 INFO:teuthology.orchestra.run.smithi137.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-13T01:28:46.611 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-13T01:28:46.616 INFO:teuthology.orchestra.run.smithi137.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-13T01:28:46.617 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-13T01:28:46.618 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-13T01:28:46.637 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-13T01:28:46.640 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-13T01:28:46.684 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-13T01:28:46.701 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-13T01:28:46.708 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-13T01:28:46.712 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-13T01:28:46.721 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-13T01:28:46.757 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-13T01:28:46.759 INFO:teuthology.orchestra.run.smithi137.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4093-g3990f91a-1focal [3,985 kB] 2023-07-13T01:28:46.765 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-13T01:28:46.770 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-13T01:28:46.799 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-13T01:28:46.805 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-13T01:28:46.808 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-13T01:28:46.810 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-13T01:28:46.820 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4093-g3990f91a-1focal [3,985 kB] 2023-07-13T01:28:46.829 INFO:teuthology.orchestra.run.smithi137.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-13T01:28:46.897 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-13T01:28:46.899 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-13T01:28:46.899 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-13T01:28:46.901 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-13T01:28:46.902 INFO:teuthology.orchestra.run.smithi022.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4093-g3990f91a-1focal [3,985 kB] 2023-07-13T01:28:46.904 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-13T01:28:46.910 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-13T01:28:46.911 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-13T01:28:46.919 INFO:teuthology.orchestra.run.smithi022.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-13T01:28:46.923 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-13T01:28:46.938 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-13T01:28:46.940 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-13T01:28:46.952 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-13T01:28:46.963 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-13T01:28:46.964 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-13T01:28:46.969 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-13T01:28:46.971 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-13T01:28:47.032 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-13T01:28:47.036 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-13T01:28:47.110 INFO:teuthology.orchestra.run.smithi022.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-13T01:28:47.167 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-13T01:28:47.177 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-13T01:28:47.184 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-13T01:28:47.188 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-13T01:28:47.190 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-13T01:28:47.203 INFO:teuthology.orchestra.run.smithi137.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-13T01:28:47.220 INFO:teuthology.orchestra.run.smithi137.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-13T01:28:47.229 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-13T01:28:47.262 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-13T01:28:47.264 INFO:teuthology.orchestra.run.smithi022.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-13T01:28:47.264 INFO:teuthology.orchestra.run.smithi022.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-13T01:28:47.268 INFO:teuthology.orchestra.run.smithi022.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-13T01:28:47.269 INFO:teuthology.orchestra.run.smithi022.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-13T01:28:47.270 INFO:teuthology.orchestra.run.smithi022.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-13T01:28:47.272 INFO:teuthology.orchestra.run.smithi022.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-13T01:28:47.272 INFO:teuthology.orchestra.run.smithi022.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-13T01:28:47.277 INFO:teuthology.orchestra.run.smithi022.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-13T01:28:47.277 INFO:teuthology.orchestra.run.smithi022.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-13T01:28:47.282 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-13T01:28:47.283 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-13T01:28:47.289 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-13T01:28:47.369 INFO:teuthology.orchestra.run.smithi022.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-13T01:28:47.419 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-13T01:28:47.430 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-13T01:28:47.469 INFO:teuthology.orchestra.run.smithi137.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4093-g3990f91a-1focal [724 kB] 2023-07-13T01:28:47.547 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-13T01:28:47.601 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4093-g3990f91a-1focal [724 kB] 2023-07-13T01:28:47.622 INFO:teuthology.orchestra.run.smithi137.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4093-g3990f91a-1focal [376 kB] 2023-07-13T01:28:47.693 INFO:teuthology.orchestra.run.smithi137.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-13T01:28:47.694 INFO:teuthology.orchestra.run.smithi137.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-13T01:28:47.695 INFO:teuthology.orchestra.run.smithi137.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-13T01:28:47.707 INFO:teuthology.orchestra.run.smithi137.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-13T01:28:47.708 INFO:teuthology.orchestra.run.smithi137.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-13T01:28:47.728 INFO:teuthology.orchestra.run.smithi137.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4093-g3990f91a-1focal [22.5 kB] 2023-07-13T01:28:47.729 INFO:teuthology.orchestra.run.smithi022.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4093-g3990f91a-1focal [724 kB] 2023-07-13T01:28:47.729 INFO:teuthology.orchestra.run.smithi137.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4093-g3990f91a-1focal [191 kB] 2023-07-13T01:28:47.731 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4093-g3990f91a-1focal [376 kB] 2023-07-13T01:28:47.733 INFO:teuthology.orchestra.run.smithi137.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4093-g3990f91a-1focal [48.3 kB] 2023-07-13T01:28:47.734 INFO:teuthology.orchestra.run.smithi137.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4093-g3990f91a-1focal [354 kB] 2023-07-13T01:28:47.749 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4093-g3990f91a-1focal [22.5 kB] 2023-07-13T01:28:47.750 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4093-g3990f91a-1focal [191 kB] 2023-07-13T01:28:47.764 INFO:teuthology.orchestra.run.smithi137.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-13T01:28:47.770 INFO:teuthology.orchestra.run.smithi137.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-13T01:28:47.771 INFO:teuthology.orchestra.run.smithi137.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-13T01:28:47.774 INFO:teuthology.orchestra.run.smithi137.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4093-g3990f91a-1focal [6,566 kB] 2023-07-13T01:28:47.776 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-13T01:28:47.793 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-13T01:28:47.798 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-13T01:28:47.799 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-13T01:28:47.800 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4093-g3990f91a-1focal [48.3 kB] 2023-07-13T01:28:47.801 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4093-g3990f91a-1focal [354 kB] 2023-07-13T01:28:47.806 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-13T01:28:47.807 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-13T01:28:47.813 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-13T01:28:47.813 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-13T01:28:47.819 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-13T01:28:47.838 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4093-g3990f91a-1focal [6,566 kB] 2023-07-13T01:28:47.848 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-13T01:28:47.851 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-13T01:28:47.858 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-13T01:28:47.866 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-13T01:28:47.868 INFO:teuthology.orchestra.run.smithi022.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4093-g3990f91a-1focal [376 kB] 2023-07-13T01:28:47.872 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-13T01:28:47.895 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-13T01:28:47.909 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-13T01:28:47.912 INFO:teuthology.orchestra.run.smithi022.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4093-g3990f91a-1focal [22.5 kB] 2023-07-13T01:28:47.912 INFO:teuthology.orchestra.run.smithi022.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4093-g3990f91a-1focal [191 kB] 2023-07-13T01:28:47.919 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-13T01:28:47.936 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-13T01:28:47.943 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-13T01:28:47.948 INFO:teuthology.orchestra.run.smithi022.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4093-g3990f91a-1focal [48.3 kB] 2023-07-13T01:28:47.950 INFO:teuthology.orchestra.run.smithi022.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4093-g3990f91a-1focal [354 kB] 2023-07-13T01:28:47.959 INFO:teuthology.orchestra.run.smithi137.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-13T01:28:47.975 INFO:teuthology.orchestra.run.smithi022.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-13T01:28:47.975 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-13T01:28:48.000 INFO:teuthology.orchestra.run.smithi022.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-13T01:28:48.022 INFO:teuthology.orchestra.run.smithi022.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-13T01:28:48.030 INFO:teuthology.orchestra.run.smithi022.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-13T01:28:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4093-g3990f91a-1focal [6,566 kB] 2023-07-13T01:28:48.051 INFO:teuthology.orchestra.run.smithi022.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-13T01:28:48.066 INFO:teuthology.orchestra.run.smithi022.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-13T01:28:48.067 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-13T01:28:48.068 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-13T01:28:48.068 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-13T01:28:48.069 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-13T01:28:48.069 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-13T01:28:48.070 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-13T01:28:48.070 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-13T01:28:48.073 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-13T01:28:48.073 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-13T01:28:48.122 INFO:teuthology.orchestra.run.smithi022.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-13T01:28:48.125 INFO:teuthology.orchestra.run.smithi022.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-13T01:28:48.129 INFO:teuthology.orchestra.run.smithi022.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-13T01:28:48.139 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-13T01:28:48.144 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-13T01:28:48.156 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-13T01:28:48.215 INFO:teuthology.orchestra.run.smithi022.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-13T01:28:48.264 INFO:teuthology.orchestra.run.smithi022.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-13T01:28:48.290 INFO:teuthology.orchestra.run.smithi022.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-13T01:28:48.313 INFO:teuthology.orchestra.run.smithi103.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4093-g3990f91a-1focal [104 kB] 2023-07-13T01:28:48.317 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4093-g3990f91a-1focal [3,985 kB] 2023-07-13T01:28:48.324 INFO:teuthology.orchestra.run.smithi022.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-13T01:28:48.331 INFO:teuthology.orchestra.run.smithi022.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-13T01:28:48.333 INFO:teuthology.orchestra.run.smithi137.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-13T01:28:48.335 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-13T01:28:48.344 INFO:teuthology.orchestra.run.smithi103.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4093-g3990f91a-1focal [466 kB] 2023-07-13T01:28:48.345 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-13T01:28:48.358 INFO:teuthology.orchestra.run.smithi137.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-13T01:28:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4093-g3990f91a-1focal [25.1 MB] 2023-07-13T01:28:48.363 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-13T01:28:48.367 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-13T01:28:48.370 INFO:teuthology.orchestra.run.smithi022.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-13T01:28:48.378 INFO:teuthology.orchestra.run.smithi137.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-13T01:28:48.391 INFO:teuthology.orchestra.run.smithi137.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-13T01:28:48.394 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-13T01:28:48.405 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-13T01:28:48.488 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4093-g3990f91a-1focal [3,985 kB] 2023-07-13T01:28:48.500 INFO:teuthology.orchestra.run.smithi137.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-13T01:28:48.510 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-13T01:28:48.517 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-13T01:28:48.524 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-13T01:28:48.540 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-13T01:28:48.574 INFO:teuthology.orchestra.run.smithi022.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-13T01:28:48.579 INFO:teuthology.orchestra.run.smithi022.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-13T01:28:48.580 INFO:teuthology.orchestra.run.smithi137.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-13T01:28:48.584 INFO:teuthology.orchestra.run.smithi022.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-13T01:28:48.589 INFO:teuthology.orchestra.run.smithi022.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-13T01:28:48.589 INFO:teuthology.orchestra.run.smithi103.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-13T01:28:48.600 INFO:teuthology.orchestra.run.smithi022.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-13T01:28:48.613 INFO:teuthology.orchestra.run.smithi103.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-13T01:28:48.625 INFO:teuthology.orchestra.run.smithi103.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-13T01:28:48.635 INFO:teuthology.orchestra.run.smithi103.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-13T01:28:48.661 INFO:teuthology.orchestra.run.smithi022.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-13T01:28:48.681 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-13T01:28:48.722 INFO:teuthology.orchestra.run.smithi137.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-13T01:28:48.723 INFO:teuthology.orchestra.run.smithi137.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-13T01:28:48.724 INFO:teuthology.orchestra.run.smithi137.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-13T01:28:48.730 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-13T01:28:48.752 INFO:teuthology.orchestra.run.smithi103.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-13T01:28:48.758 INFO:teuthology.orchestra.run.smithi022.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-13T01:28:48.810 INFO:teuthology.orchestra.run.smithi103.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-13T01:28:48.813 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-13T01:28:48.833 INFO:teuthology.orchestra.run.smithi022.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-13T01:28:48.834 INFO:teuthology.orchestra.run.smithi137.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4093-g3990f91a-1focal [104 kB] 2023-07-13T01:28:48.842 INFO:teuthology.orchestra.run.smithi137.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4093-g3990f91a-1focal [466 kB] 2023-07-13T01:28:48.852 INFO:teuthology.orchestra.run.smithi103.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-13T01:28:48.853 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-13T01:28:48.857 INFO:teuthology.orchestra.run.smithi103.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-13T01:28:48.870 INFO:teuthology.orchestra.run.smithi103.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-13T01:28:48.895 INFO:teuthology.orchestra.run.smithi137.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4093-g3990f91a-1focal [25.1 MB] 2023-07-13T01:28:48.898 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-13T01:28:48.915 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-13T01:28:48.922 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-13T01:28:48.923 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-13T01:28:48.930 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-13T01:28:48.939 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-13T01:28:48.951 INFO:teuthology.orchestra.run.smithi022.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-13T01:28:48.956 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-13T01:28:48.962 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-13T01:28:48.962 INFO:teuthology.orchestra.run.smithi022.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-13T01:28:49.006 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-13T01:28:49.050 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-13T01:28:49.059 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-13T01:28:49.146 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-13T01:28:49.147 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-13T01:28:49.151 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-13T01:28:49.151 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-13T01:28:49.159 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-13T01:28:49.164 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-13T01:28:49.275 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-13T01:28:49.333 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-13T01:28:49.401 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-13T01:28:49.429 INFO:teuthology.orchestra.run.smithi137.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-13T01:28:49.568 INFO:teuthology.orchestra.run.smithi103.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-13T01:28:49.577 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-13T01:28:49.598 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-13T01:28:49.627 INFO:teuthology.orchestra.run.smithi022.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4093-g3990f91a-1focal [104 kB] 2023-07-13T01:28:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4093-g3990f91a-1focal [466 kB] 2023-07-13T01:28:49.718 INFO:teuthology.orchestra.run.smithi137.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-13T01:28:49.768 INFO:teuthology.orchestra.run.smithi022.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4093-g3990f91a-1focal [25.1 MB] 2023-07-13T01:28:49.782 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-13T01:28:49.811 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-13T01:28:49.824 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-13T01:28:49.833 INFO:teuthology.orchestra.run.smithi103.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-13T01:28:49.836 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-13T01:28:49.926 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-13T01:28:49.986 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-13T01:28:50.018 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-13T01:28:50.022 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-13T01:28:50.030 INFO:teuthology.orchestra.run.smithi084.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-13T01:28:50.224 INFO:teuthology.orchestra.run.smithi137.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-13T01:28:50.326 INFO:teuthology.orchestra.run.smithi103.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-13T01:28:50.397 INFO:teuthology.orchestra.run.smithi103.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4093-g3990f91a-1focal [10.9 MB] 2023-07-13T01:28:50.559 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4093-g3990f91a-1focal [724 kB] 2023-07-13T01:28:50.654 INFO:teuthology.orchestra.run.smithi137.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-13T01:28:50.655 INFO:teuthology.orchestra.run.smithi137.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-13T01:28:50.666 INFO:teuthology.orchestra.run.smithi137.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-13T01:28:50.673 INFO:teuthology.orchestra.run.smithi137.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-13T01:28:50.676 INFO:teuthology.orchestra.run.smithi137.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-13T01:28:50.677 INFO:teuthology.orchestra.run.smithi084.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-13T01:28:50.680 INFO:teuthology.orchestra.run.smithi137.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-13T01:28:50.681 INFO:teuthology.orchestra.run.smithi137.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-13T01:28:50.685 INFO:teuthology.orchestra.run.smithi137.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-13T01:28:50.686 INFO:teuthology.orchestra.run.smithi137.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-13T01:28:50.842 INFO:teuthology.orchestra.run.smithi103.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-13T01:28:50.842 INFO:teuthology.orchestra.run.smithi103.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-13T01:28:50.845 INFO:teuthology.orchestra.run.smithi103.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-13T01:28:50.848 INFO:teuthology.orchestra.run.smithi103.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-13T01:28:50.851 INFO:teuthology.orchestra.run.smithi103.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-13T01:28:50.855 INFO:teuthology.orchestra.run.smithi103.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-13T01:28:50.857 INFO:teuthology.orchestra.run.smithi103.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-13T01:28:50.866 INFO:teuthology.orchestra.run.smithi103.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-13T01:28:50.867 INFO:teuthology.orchestra.run.smithi103.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-13T01:28:50.894 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4093-g3990f91a-1focal [376 kB] 2023-07-13T01:28:50.906 INFO:teuthology.orchestra.run.smithi137.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-13T01:28:50.969 INFO:teuthology.orchestra.run.smithi084.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4093-g3990f91a-1focal [724 kB] 2023-07-13T01:28:50.991 INFO:teuthology.orchestra.run.smithi084.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-13T01:28:51.095 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4093-g3990f91a-1focal [22.5 kB] 2023-07-13T01:28:51.103 INFO:teuthology.orchestra.run.smithi103.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-13T01:28:51.139 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4093-g3990f91a-1focal [191 kB] 2023-07-13T01:28:51.167 INFO:teuthology.orchestra.run.smithi103.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4093-g3990f91a-1focal [223 kB] 2023-07-13T01:28:51.188 INFO:teuthology.orchestra.run.smithi103.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4093-g3990f91a-1focal [133 kB] 2023-07-13T01:28:51.193 INFO:teuthology.orchestra.run.smithi103.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4093-g3990f91a-1focal [1,551 kB] 2023-07-13T01:28:51.201 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4093-g3990f91a-1focal [48.3 kB] 2023-07-13T01:28:51.238 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4093-g3990f91a-1focal [354 kB] 2023-07-13T01:28:51.283 INFO:teuthology.orchestra.run.smithi103.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4093-g3990f91a-1focal [9,386 kB] 2023-07-13T01:28:51.354 INFO:teuthology.orchestra.run.smithi084.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4093-g3990f91a-1focal [376 kB] 2023-07-13T01:28:51.384 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4093-g3990f91a-1focal [6,566 kB] 2023-07-13T01:28:51.525 INFO:teuthology.orchestra.run.smithi137.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-13T01:28:51.526 INFO:teuthology.orchestra.run.smithi084.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-13T01:28:51.565 INFO:teuthology.orchestra.run.smithi137.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-13T01:28:51.579 INFO:teuthology.orchestra.run.smithi084.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4093-g3990f91a-1focal [22.5 kB] 2023-07-13T01:28:51.580 INFO:teuthology.orchestra.run.smithi084.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4093-g3990f91a-1focal [191 kB] 2023-07-13T01:28:51.601 INFO:teuthology.orchestra.run.smithi137.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-13T01:28:51.626 INFO:teuthology.orchestra.run.smithi137.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-13T01:28:51.664 INFO:teuthology.orchestra.run.smithi084.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4093-g3990f91a-1focal [48.3 kB] 2023-07-13T01:28:51.683 INFO:teuthology.orchestra.run.smithi103.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-13T01:28:51.700 INFO:teuthology.orchestra.run.smithi084.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4093-g3990f91a-1focal [354 kB] 2023-07-13T01:28:51.707 INFO:teuthology.orchestra.run.smithi137.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-13T01:28:51.728 INFO:teuthology.orchestra.run.smithi103.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-13T01:28:51.746 INFO:teuthology.orchestra.run.smithi137.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-13T01:28:51.763 INFO:teuthology.orchestra.run.smithi103.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-13T01:28:51.792 INFO:teuthology.orchestra.run.smithi103.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-13T01:28:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-13T01:28:51.878 INFO:teuthology.orchestra.run.smithi084.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-13T01:28:51.883 INFO:teuthology.orchestra.run.smithi084.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-13T01:28:51.886 INFO:teuthology.orchestra.run.smithi084.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-13T01:28:51.888 INFO:teuthology.orchestra.run.smithi084.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-13T01:28:51.888 INFO:teuthology.orchestra.run.smithi103.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-13T01:28:51.891 INFO:teuthology.orchestra.run.smithi084.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-13T01:28:51.892 INFO:teuthology.orchestra.run.smithi084.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-13T01:28:51.900 INFO:teuthology.orchestra.run.smithi084.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-13T01:28:51.900 INFO:teuthology.orchestra.run.smithi084.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4093-g3990f91a-1focal [6,566 kB] 2023-07-13T01:28:51.901 INFO:teuthology.orchestra.run.smithi084.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-13T01:28:51.924 INFO:teuthology.orchestra.run.smithi103.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-13T01:28:51.925 INFO:teuthology.orchestra.run.smithi137.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-13T01:28:51.929 INFO:teuthology.orchestra.run.smithi103.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4093-g3990f91a-1focal [31.3 MB] 2023-07-13T01:28:51.936 INFO:teuthology.orchestra.run.smithi137.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-13T01:28:51.949 INFO:teuthology.orchestra.run.smithi137.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-13T01:28:52.138 INFO:teuthology.orchestra.run.smithi103.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-13T01:28:52.139 INFO:teuthology.orchestra.run.smithi084.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-13T01:28:52.152 INFO:teuthology.orchestra.run.smithi103.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-13T01:28:52.169 INFO:teuthology.orchestra.run.smithi103.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-13T01:28:52.172 INFO:teuthology.orchestra.run.smithi137.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-13T01:28:52.383 INFO:teuthology.orchestra.run.smithi103.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-13T01:28:52.399 INFO:teuthology.orchestra.run.smithi137.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-13T01:28:52.499 INFO:teuthology.orchestra.run.smithi137.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-13T01:28:52.583 INFO:teuthology.orchestra.run.smithi103.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-13T01:28:52.675 INFO:teuthology.orchestra.run.smithi103.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-13T01:28:52.678 INFO:teuthology.orchestra.run.smithi137.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-13T01:28:52.679 INFO:teuthology.orchestra.run.smithi137.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-13T01:28:52.679 INFO:teuthology.orchestra.run.smithi137.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4093-g3990f91a-1focal [10.9 MB] 2023-07-13T01:28:52.727 INFO:teuthology.orchestra.run.smithi084.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-13T01:28:52.775 INFO:teuthology.orchestra.run.smithi084.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-13T01:28:52.789 INFO:teuthology.orchestra.run.smithi137.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-13T01:28:52.790 INFO:teuthology.orchestra.run.smithi103.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-13T01:28:52.806 INFO:teuthology.orchestra.run.smithi084.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-13T01:28:52.826 INFO:teuthology.orchestra.run.smithi103.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-13T01:28:52.832 INFO:teuthology.orchestra.run.smithi084.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-13T01:28:52.913 INFO:teuthology.orchestra.run.smithi084.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-13T01:28:52.942 INFO:teuthology.orchestra.run.smithi084.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-13T01:28:52.952 INFO:teuthology.orchestra.run.smithi103.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-13T01:28:53.105 INFO:teuthology.orchestra.run.smithi084.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-13T01:28:53.133 INFO:teuthology.orchestra.run.smithi084.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-13T01:28:53.134 INFO:teuthology.orchestra.run.smithi084.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-13T01:28:53.134 INFO:teuthology.orchestra.run.smithi137.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-13T01:28:53.136 INFO:teuthology.orchestra.run.smithi137.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-13T01:28:53.137 INFO:teuthology.orchestra.run.smithi137.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-13T01:28:53.142 INFO:teuthology.orchestra.run.smithi137.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-13T01:28:53.152 INFO:teuthology.orchestra.run.smithi137.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-13T01:28:53.157 INFO:teuthology.orchestra.run.smithi137.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-13T01:28:53.392 INFO:teuthology.orchestra.run.smithi137.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-13T01:28:53.452 INFO:teuthology.orchestra.run.smithi103.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-13T01:28:53.453 INFO:teuthology.orchestra.run.smithi103.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-13T01:28:53.454 INFO:teuthology.orchestra.run.smithi103.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-13T01:28:53.454 INFO:teuthology.orchestra.run.smithi103.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-13T01:28:53.458 INFO:teuthology.orchestra.run.smithi103.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-13T01:28:53.459 INFO:teuthology.orchestra.run.smithi103.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-13T01:28:53.484 INFO:teuthology.orchestra.run.smithi084.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-13T01:28:53.611 INFO:teuthology.orchestra.run.smithi137.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-13T01:28:53.666 INFO:teuthology.orchestra.run.smithi103.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-13T01:28:53.765 INFO:teuthology.orchestra.run.smithi084.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-13T01:28:53.868 INFO:teuthology.orchestra.run.smithi103.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-13T01:28:53.871 INFO:teuthology.orchestra.run.smithi084.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-13T01:28:53.931 INFO:teuthology.orchestra.run.smithi137.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-13T01:28:53.964 INFO:teuthology.orchestra.run.smithi137.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-13T01:28:53.995 INFO:teuthology.orchestra.run.smithi084.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-13T01:28:54.021 INFO:teuthology.orchestra.run.smithi084.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-13T01:28:54.112 INFO:teuthology.orchestra.run.smithi103.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4093-g3990f91a-1focal [3,816 B] 2023-07-13T01:28:54.112 INFO:teuthology.orchestra.run.smithi103.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4093-g3990f91a-1focal [833 kB] 2023-07-13T01:28:54.118 INFO:teuthology.orchestra.run.smithi103.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4093-g3990f91a-1focal [2,292 kB] 2023-07-13T01:28:54.156 INFO:teuthology.orchestra.run.smithi084.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-13T01:28:54.175 INFO:teuthology.orchestra.run.smithi103.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4093-g3990f91a-1focal [211 kB] 2023-07-13T01:28:54.179 INFO:teuthology.orchestra.run.smithi103.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-13T01:28:54.183 INFO:teuthology.orchestra.run.smithi103.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4093-g3990f91a-1focal [122 kB] 2023-07-13T01:28:54.218 INFO:teuthology.orchestra.run.smithi103.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4093-g3990f91a-1focal [1,776 kB] 2023-07-13T01:28:54.219 INFO:teuthology.orchestra.run.smithi103.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-13T01:28:54.297 INFO:teuthology.orchestra.run.smithi103.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4093-g3990f91a-1focal [7,866 kB] 2023-07-13T01:28:54.356 INFO:teuthology.orchestra.run.smithi137.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4093-g3990f91a-1focal [223 kB] 2023-07-13T01:28:54.361 INFO:teuthology.orchestra.run.smithi137.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4093-g3990f91a-1focal [133 kB] 2023-07-13T01:28:54.378 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4093-g3990f91a-1focal [104 kB] 2023-07-13T01:28:54.408 INFO:teuthology.orchestra.run.smithi137.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4093-g3990f91a-1focal [1,551 kB] 2023-07-13T01:28:54.438 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4093-g3990f91a-1focal [466 kB] 2023-07-13T01:28:54.503 INFO:teuthology.orchestra.run.smithi084.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-13T01:28:54.505 INFO:teuthology.orchestra.run.smithi084.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-13T01:28:54.511 INFO:teuthology.orchestra.run.smithi084.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-13T01:28:54.513 INFO:teuthology.orchestra.run.smithi084.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-13T01:28:54.522 INFO:teuthology.orchestra.run.smithi084.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-13T01:28:54.528 INFO:teuthology.orchestra.run.smithi084.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-13T01:28:54.629 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4093-g3990f91a-1focal [25.1 MB] 2023-07-13T01:28:54.660 INFO:teuthology.orchestra.run.smithi137.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4093-g3990f91a-1focal [9,386 kB] 2023-07-13T01:28:54.730 INFO:teuthology.orchestra.run.smithi084.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-13T01:28:54.785 INFO:teuthology.orchestra.run.smithi103.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4093-g3990f91a-1focal [3,932 B] 2023-07-13T01:28:54.785 INFO:teuthology.orchestra.run.smithi103.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4093-g3990f91a-1focal [43.8 MB] 2023-07-13T01:28:54.929 INFO:teuthology.orchestra.run.smithi084.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-13T01:28:55.211 INFO:teuthology.orchestra.run.smithi084.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-13T01:28:55.242 INFO:teuthology.orchestra.run.smithi084.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-13T01:28:55.333 INFO:teuthology.orchestra.run.smithi084.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4093-g3990f91a-1focal [104 kB] 2023-07-13T01:28:55.368 INFO:teuthology.orchestra.run.smithi084.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4093-g3990f91a-1focal [466 kB] 2023-07-13T01:28:55.589 INFO:teuthology.orchestra.run.smithi084.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4093-g3990f91a-1focal [25.1 MB] 2023-07-13T01:28:56.098 INFO:teuthology.orchestra.run.smithi137.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4093-g3990f91a-1focal [31.3 MB] 2023-07-13T01:28:56.206 INFO:teuthology.orchestra.run.smithi022.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4093-g3990f91a-1focal [10.9 MB] 2023-07-13T01:29:02.201 INFO:teuthology.orchestra.run.smithi022.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4093-g3990f91a-1focal [223 kB] 2023-07-13T01:29:02.284 INFO:teuthology.orchestra.run.smithi022.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4093-g3990f91a-1focal [133 kB] 2023-07-13T01:29:02.322 INFO:teuthology.orchestra.run.smithi022.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4093-g3990f91a-1focal [1,551 kB] 2023-07-13T01:29:02.837 INFO:teuthology.orchestra.run.smithi022.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4093-g3990f91a-1focal [9,386 kB] 2023-07-13T01:29:03.092 INFO:teuthology.orchestra.run.smithi103.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4093-g3990f91a-1focal [227 kB] 2023-07-13T01:29:03.139 INFO:teuthology.orchestra.run.smithi103.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4093-g3990f91a-1focal [28.0 kB] 2023-07-13T01:29:03.139 INFO:teuthology.orchestra.run.smithi103.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4093-g3990f91a-1focal [13.4 MB] 2023-07-13T01:29:07.176 INFO:teuthology.orchestra.run.smithi022.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4093-g3990f91a-1focal [31.3 MB] 2023-07-13T01:29:08.809 INFO:teuthology.orchestra.run.smithi084.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4093-g3990f91a-1focal [10.9 MB] 2023-07-13T01:29:09.413 INFO:teuthology.orchestra.run.smithi103.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4093-g3990f91a-1focal [97.3 kB] 2023-07-13T01:29:09.592 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4093-g3990f91a-1focal [10.9 MB] 2023-07-13T01:29:10.056 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 201 MB in 25s (8,122 kB/s) 2023-07-13T01:29:10.332 INFO:teuthology.orchestra.run.smithi137.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4093-g3990f91a-1focal [3,816 B] 2023-07-13T01:29:10.332 INFO:teuthology.orchestra.run.smithi137.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4093-g3990f91a-1focal [833 kB] 2023-07-13T01:29:10.344 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-13T01:29:10.391 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112643 files and directories currently installed.) 2023-07-13T01:29:10.394 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-13T01:29:10.461 INFO:teuthology.orchestra.run.smithi137.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4093-g3990f91a-1focal [2,292 kB] 2023-07-13T01:29:10.493 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:29:10.822 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-13T01:29:10.838 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-13T01:29:10.880 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:29:11.109 INFO:teuthology.orchestra.run.smithi137.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4093-g3990f91a-1focal [211 kB] 2023-07-13T01:29:11.189 INFO:teuthology.orchestra.run.smithi137.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4093-g3990f91a-1focal [122 kB] 2023-07-13T01:29:11.222 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-13T01:29:11.238 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-13T01:29:11.257 INFO:teuthology.orchestra.run.smithi137.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4093-g3990f91a-1focal [1,776 kB] 2023-07-13T01:29:11.281 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:29:11.743 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-13T01:29:11.757 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:11.810 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:12.001 INFO:teuthology.orchestra.run.smithi084.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4093-g3990f91a-1focal [223 kB] 2023-07-13T01:29:12.026 INFO:teuthology.orchestra.run.smithi137.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4093-g3990f91a-1focal [7,866 kB] 2023-07-13T01:29:12.051 INFO:teuthology.orchestra.run.smithi084.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4093-g3990f91a-1focal [133 kB] 2023-07-13T01:29:12.091 INFO:teuthology.orchestra.run.smithi084.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4093-g3990f91a-1focal [1,551 kB] 2023-07-13T01:29:12.339 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-13T01:29:12.354 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:12.397 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4093-g3990f91a-1focal [9,386 kB] 2023-07-13T01:29:12.734 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-13T01:29:12.750 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:12.793 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:13.213 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-13T01:29:13.227 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-13T01:29:13.280 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:29:13.682 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../007-librbd1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:13.836 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librbd1 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:14.064 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4093-g3990f91a-1focal [223 kB] 2023-07-13T01:29:14.121 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4093-g3990f91a-1focal [133 kB] 2023-07-13T01:29:14.159 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4093-g3990f91a-1focal [1,551 kB] 2023-07-13T01:29:14.431 INFO:teuthology.orchestra.run.smithi137.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4093-g3990f91a-1focal [3,932 B] 2023-07-13T01:29:14.431 INFO:teuthology.orchestra.run.smithi137.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4093-g3990f91a-1focal [43.8 MB] 2023-07-13T01:29:14.571 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../008-librados2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:14.717 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librados2 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:14.825 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4093-g3990f91a-1focal [9,386 kB] 2023-07-13T01:29:15.332 INFO:teuthology.orchestra.run.smithi084.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4093-g3990f91a-1focal [31.3 MB] 2023-07-13T01:29:15.479 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs2. 2023-07-13T01:29:15.493 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:15.540 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rados. 2023-07-13T01:29:15.879 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../010-python3-rados_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:15.924 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:16.268 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-13T01:29:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:16.318 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:16.571 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cephfs. 2023-07-13T01:29:16.586 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:16.629 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:16.949 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-13T01:29:16.962 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:17.007 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:17.335 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-prettytable. 2023-07-13T01:29:17.349 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-07-13T01:29:17.394 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-13T01:29:17.630 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rbd. 2023-07-13T01:29:17.643 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:17.680 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:18.066 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-13T01:29:18.082 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-13T01:29:18.124 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:29:18.520 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-13T01:29:18.534 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-13T01:29:18.586 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:29:19.453 INFO:teuthology.orchestra.run.smithi022.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4093-g3990f91a-1focal [3,816 B] 2023-07-13T01:29:19.453 INFO:teuthology.orchestra.run.smithi022.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4093-g3990f91a-1focal [833 kB] 2023-07-13T01:29:19.615 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-13T01:29:19.630 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-13T01:29:19.673 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:29:19.950 INFO:teuthology.orchestra.run.smithi022.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4093-g3990f91a-1focal [2,292 kB] 2023-07-13T01:29:20.017 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librgw2. 2023-07-13T01:29:20.031 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../019-librgw2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:20.076 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:20.381 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4093-g3990f91a-1focal [31.3 MB] 2023-07-13T01:29:20.995 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rgw. 2023-07-13T01:29:21.009 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:21.061 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:21.096 INFO:teuthology.orchestra.run.smithi022.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4093-g3990f91a-1focal [211 kB] 2023-07-13T01:29:21.190 INFO:teuthology.orchestra.run.smithi022.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4093-g3990f91a-1focal [122 kB] 2023-07-13T01:29:21.242 INFO:teuthology.orchestra.run.smithi022.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4093-g3990f91a-1focal [1,776 kB] 2023-07-13T01:29:21.429 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liboath0. 2023-07-13T01:29:21.442 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-13T01:29:21.479 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-13T01:29:21.820 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libradosstriper1. 2023-07-13T01:29:21.834 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:21.878 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:21.942 INFO:teuthology.orchestra.run.smithi022.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4093-g3990f91a-1focal [7,866 kB] 2023-07-13T01:29:22.363 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-common. 2023-07-13T01:29:22.378 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../023-ceph-common_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:22.430 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:24.301 INFO:teuthology.orchestra.run.smithi022.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4093-g3990f91a-1focal [3,932 B] 2023-07-13T01:29:24.302 INFO:teuthology.orchestra.run.smithi022.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4093-g3990f91a-1focal [43.8 MB] 2023-07-13T01:29:24.936 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-base. 2023-07-13T01:29:24.950 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../024-ceph-base_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:25.013 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:26.525 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-13T01:29:26.538 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-13T01:29:26.591 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:29:26.920 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-natsort. 2023-07-13T01:29:26.934 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-07-13T01:29:26.986 INFO:teuthology.orchestra.run.smithi084.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4093-g3990f91a-1focal [3,816 B] 2023-07-13T01:29:26.987 INFO:teuthology.orchestra.run.smithi084.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4093-g3990f91a-1focal [833 kB] 2023-07-13T01:29:26.987 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-13T01:29:27.078 INFO:teuthology.orchestra.run.smithi084.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4093-g3990f91a-1focal [2,292 kB] 2023-07-13T01:29:27.365 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-logutils. 2023-07-13T01:29:27.381 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-07-13T01:29:27.432 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-13T01:29:27.525 INFO:teuthology.orchestra.run.smithi084.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4093-g3990f91a-1focal [211 kB] 2023-07-13T01:29:27.573 INFO:teuthology.orchestra.run.smithi084.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4093-g3990f91a-1focal [122 kB] 2023-07-13T01:29:27.582 INFO:teuthology.orchestra.run.smithi084.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4093-g3990f91a-1focal [1,776 kB] 2023-07-13T01:29:27.752 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-13T01:29:27.765 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-13T01:29:27.810 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:29:27.837 INFO:teuthology.orchestra.run.smithi084.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4093-g3990f91a-1focal [7,866 kB] 2023-07-13T01:29:28.012 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4093-g3990f91a-1focal [3,816 B] 2023-07-13T01:29:28.012 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4093-g3990f91a-1focal [833 kB] 2023-07-13T01:29:28.026 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4093-g3990f91a-1focal [2,292 kB] 2023-07-13T01:29:28.163 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-mako. 2023-07-13T01:29:28.176 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-13T01:29:28.229 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:29:28.242 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4093-g3990f91a-1focal [211 kB] 2023-07-13T01:29:28.281 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4093-g3990f91a-1focal [122 kB] 2023-07-13T01:29:28.285 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4093-g3990f91a-1focal [1,776 kB] 2023-07-13T01:29:28.476 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4093-g3990f91a-1focal [7,866 kB] 2023-07-13T01:29:28.575 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-13T01:29:28.590 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-13T01:29:28.633 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:29:28.899 INFO:teuthology.orchestra.run.smithi084.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4093-g3990f91a-1focal [3,932 B] 2023-07-13T01:29:28.900 INFO:teuthology.orchestra.run.smithi084.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4093-g3990f91a-1focal [43.8 MB] 2023-07-13T01:29:28.978 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-13T01:29:28.991 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-13T01:29:29.033 INFO:teuthology.orchestra.run.smithi137.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4093-g3990f91a-1focal [227 kB] 2023-07-13T01:29:29.044 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:29:29.047 INFO:teuthology.orchestra.run.smithi137.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4093-g3990f91a-1focal [28.0 kB] 2023-07-13T01:29:29.048 INFO:teuthology.orchestra.run.smithi137.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4093-g3990f91a-1focal [13.4 MB] 2023-07-13T01:29:29.321 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4093-g3990f91a-1focal [3,932 B] 2023-07-13T01:29:29.322 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4093-g3990f91a-1focal [43.8 MB] 2023-07-13T01:29:29.406 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webob. 2023-07-13T01:29:29.421 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-13T01:29:29.472 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-13T01:29:30.176 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-13T01:29:30.189 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-13T01:29:30.225 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:29:30.530 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bs4. 2023-07-13T01:29:30.545 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-07-13T01:29:30.621 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-13T01:29:30.878 INFO:teuthology.orchestra.run.smithi137.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4093-g3990f91a-1focal [97.3 kB] 2023-07-13T01:29:30.975 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-waitress. 2023-07-13T01:29:30.990 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-13T01:29:31.036 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:29:31.353 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempita. 2023-07-13T01:29:31.369 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-07-13T01:29:31.411 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-13T01:29:31.538 INFO:teuthology.orchestra.run.smithi137.stdout:Fetched 201 MB in 46s (4,344 kB/s) 2023-07-13T01:29:31.714 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-paste. 2023-07-13T01:29:31.727 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-13T01:29:31.728 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-13T01:29:31.772 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:29:31.774 INFO:teuthology.orchestra.run.smithi137.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112643 files and directories currently installed.) 2023-07-13T01:29:31.778 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-13T01:29:31.859 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:29:31.963 INFO:teuthology.orchestra.run.smithi022.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4093-g3990f91a-1focal [227 kB] 2023-07-13T01:29:31.965 INFO:teuthology.orchestra.run.smithi022.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4093-g3990f91a-1focal [28.0 kB] 2023-07-13T01:29:31.965 INFO:teuthology.orchestra.run.smithi022.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4093-g3990f91a-1focal [13.4 MB] 2023-07-13T01:29:32.076 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-13T01:29:32.089 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-13T01:29:32.126 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:29:32.254 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-13T01:29:32.268 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-13T01:29:32.321 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:29:32.429 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-13T01:29:32.443 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-13T01:29:32.487 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:29:32.665 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-13T01:29:32.678 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-13T01:29:32.715 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:29:32.799 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webtest. 2023-07-13T01:29:32.812 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-07-13T01:29:32.849 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-13T01:29:33.202 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pecan. 2023-07-13T01:29:33.215 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-13T01:29:33.260 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:29:33.278 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-13T01:29:33.294 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:33.355 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:33.392 INFO:teuthology.orchestra.run.smithi084.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4093-g3990f91a-1focal [227 kB] 2023-07-13T01:29:33.393 INFO:teuthology.orchestra.run.smithi084.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4093-g3990f91a-1focal [28.0 kB] 2023-07-13T01:29:33.394 INFO:teuthology.orchestra.run.smithi084.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4093-g3990f91a-1focal [13.4 MB] 2023-07-13T01:29:33.422 INFO:teuthology.orchestra.run.smithi022.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4093-g3990f91a-1focal [97.3 kB] 2023-07-13T01:29:33.633 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-13T01:29:33.646 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-13T01:29:33.686 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:29:33.816 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-13T01:29:33.829 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:33.868 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:33.984 INFO:teuthology.orchestra.run.smithi084.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4093-g3990f91a-1focal [97.3 kB] 2023-07-13T01:29:34.003 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-13T01:29:34.016 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:34.060 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:34.095 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 201 MB in 49s (4,128 kB/s) 2023-07-13T01:29:34.137 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4093-g3990f91a-1focal [227 kB] 2023-07-13T01:29:34.138 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4093-g3990f91a-1focal [28.0 kB] 2023-07-13T01:29:34.139 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4093-g3990f91a-1focal [13.4 MB] 2023-07-13T01:29:34.230 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-13T01:29:34.246 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:34.261 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-13T01:29:34.280 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:34.308 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112643 files and directories currently installed.) 2023-07-13T01:29:34.312 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-13T01:29:34.393 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:29:34.433 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-13T01:29:34.446 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:34.491 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:34.634 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 201 MB in 48s (4,167 kB/s) 2023-07-13T01:29:34.687 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-13T01:29:34.699 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-13T01:29:34.742 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:29:34.754 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-13T01:29:34.769 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-13T01:29:34.810 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-13T01:29:34.812 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:29:34.819 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cryptography. 2023-07-13T01:29:34.833 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-13T01:29:34.860 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112643 files and directories currently installed.) 2023-07-13T01:29:34.863 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-13T01:29:34.877 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:29:34.888 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4093-g3990f91a-1focal [97.3 kB] 2023-07-13T01:29:34.950 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:29:35.135 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../007-librbd1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:35.157 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-13T01:29:35.171 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-13T01:29:35.216 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:29:35.262 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librbd1 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:35.264 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-openssl. 2023-07-13T01:29:35.277 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-13T01:29:35.304 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-13T01:29:35.314 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-13T01:29:35.317 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-13T01:29:35.355 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:29:35.539 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 201 MB in 49s (4,093 kB/s) 2023-07-13T01:29:35.651 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr. 2023-07-13T01:29:35.664 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:35.673 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-13T01:29:35.695 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-13T01:29:35.701 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-13T01:29:35.703 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:35.709 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:35.713 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-13T01:29:35.715 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 112643 files and directories currently installed.) 2023-07-13T01:29:35.718 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-13T01:29:35.763 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:35.775 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:29:35.798 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:29:35.904 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../008-librados2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:36.016 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librados2 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:36.143 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-13T01:29:36.151 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-13T01:29:36.193 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:29:36.213 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mon. 2023-07-13T01:29:36.226 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:36.254 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-13T01:29:36.268 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:36.270 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:36.282 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-13T01:29:36.295 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:36.322 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:36.331 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:36.529 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-13T01:29:36.538 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-13T01:29:36.579 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:29:36.652 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-13T01:29:36.666 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:36.702 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:36.737 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs2. 2023-07-13T01:29:36.750 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:36.795 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:36.825 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-13T01:29:36.840 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:36.883 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:37.046 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-13T01:29:37.060 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:37.081 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-13T01:29:37.096 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-13T01:29:37.106 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:37.131 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rados. 2023-07-13T01:29:37.146 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../010-python3-rados_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:37.164 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:29:37.189 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:37.262 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-13T01:29:37.276 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:37.320 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../007-librbd1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:37.558 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-osd. 2023-07-13T01:29:37.571 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:37.575 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-13T01:29:37.588 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:37.616 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:37.625 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:37.643 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librbd1 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:37.650 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-13T01:29:37.663 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:37.700 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:37.706 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-13T01:29:37.720 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-13T01:29:37.756 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:29:37.861 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cephfs. 2023-07-13T01:29:37.874 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:37.911 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:38.086 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-13T01:29:38.095 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-13T01:29:38.108 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../007-librbd1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:38.137 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:29:38.226 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librbd1 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:38.264 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-13T01:29:38.278 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:38.321 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:38.327 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../008-librados2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:38.455 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librados2 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:38.506 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-13T01:29:38.515 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-13T01:29:38.556 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:29:38.658 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-prettytable. 2023-07-13T01:29:38.673 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-07-13T01:29:38.716 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-13T01:29:38.911 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librbd1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:38.929 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../008-librados2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:38.977 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rbd. 2023-07-13T01:29:38.991 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:39.035 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:39.036 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:39.057 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librados2 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:39.176 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libcephfs2. 2023-07-13T01:29:39.190 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:39.234 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:39.430 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-13T01:29:39.443 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-13T01:29:39.496 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:29:39.578 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rados. 2023-07-13T01:29:39.592 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../010-python3-rados_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:39.636 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:39.707 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-librados2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:39.761 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs2. 2023-07-13T01:29:39.776 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:39.819 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:39.833 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (18.0.0-4093-g3990f91a-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-13T01:29:39.916 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-13T01:29:39.930 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-13T01:29:39.982 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:29:39.988 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-13T01:29:40.004 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:40.038 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.155 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rados. 2023-07-13T01:29:40.169 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../010-python3-rados_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.213 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.266 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cephfs. 2023-07-13T01:29:40.279 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.316 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.365 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-13T01:29:40.379 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-13T01:29:40.424 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:29:40.549 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-13T01:29:40.555 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2023-07-13T01:29:40.563 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libcephfs2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.564 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:40.605 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.607 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.652 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-13T01:29:40.667 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:40.687 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph. 2023-07-13T01:29:40.701 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../050-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.743 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.744 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.843 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cephfs. 2023-07-13T01:29:40.848 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package librgw2. 2023-07-13T01:29:40.856 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.862 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../019-librgw2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.901 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.908 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2023-07-13T01:29:40.915 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:40.917 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-python3-rados_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:40.958 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.047 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-fuse. 2023-07-13T01:29:41.060 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:41.071 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-prettytable. 2023-07-13T01:29:41.085 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-07-13T01:29:41.097 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.121 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-13T01:29:41.229 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-13T01:29:41.244 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:41.287 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.336 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-13T01:29:41.350 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:41.365 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rbd. 2023-07-13T01:29:41.380 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:41.386 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.424 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.509 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mds. 2023-07-13T01:29:41.522 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:41.567 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.597 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2023-07-13T01:29:41.612 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-cephfs_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:41.615 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-prettytable. 2023-07-13T01:29:41.629 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-07-13T01:29:41.655 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.673 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-13T01:29:41.776 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-13T01:29:41.792 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-13T01:29:41.803 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rgw. 2023-07-13T01:29:41.818 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:41.834 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:29:41.864 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:41.942 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rbd. 2023-07-13T01:29:41.956 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:41.991 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-13T01:29:41.992 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:42.005 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-ceph-common_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:42.050 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:42.078 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephadm. 2023-07-13T01:29:42.091 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../053-cephadm_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:42.137 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:42.196 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-13T01:29:42.209 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-13T01:29:42.233 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liboath0. 2023-07-13T01:29:42.242 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-13T01:29:42.254 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:29:42.283 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-13T01:29:42.344 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2023-07-13T01:29:42.345 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-13T01:29:42.358 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2023-07-13T01:29:42.360 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-13T01:29:42.394 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-13T01:29:42.396 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:29:42.423 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-13T01:29:42.437 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-13T01:29:42.481 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-13T01:29:42.586 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libradosstriper1. 2023-07-13T01:29:42.595 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:42.598 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-13T01:29:42.612 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-13T01:29:42.636 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:42.647 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2023-07-13T01:29:42.648 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:29:42.661 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-rbd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:42.705 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:42.748 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-13T01:29:42.762 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-13T01:29:42.807 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:29:42.826 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jinja2. 2023-07-13T01:29:42.839 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-07-13T01:29:42.884 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-13T01:29:42.989 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librgw2. 2023-07-13T01:29:43.004 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../019-librgw2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:43.040 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:43.050 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-13T01:29:43.063 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-13T01:29:43.098 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-common. 2023-07-13T01:29:43.112 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../023-ceph-common_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:43.133 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:29:43.152 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-13T01:29:43.156 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:43.167 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-13T01:29:43.196 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-13T01:29:43.209 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:43.210 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:29:43.254 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:43.452 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-13T01:29:43.466 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-13T01:29:43.511 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:29:43.552 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librgw2. 2023-07-13T01:29:43.567 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../019-librgw2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:43.610 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:43.616 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-13T01:29:43.629 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-13T01:29:43.682 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:29:43.788 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-13T01:29:43.804 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-13T01:29:43.847 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:29:43.921 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rgw. 2023-07-13T01:29:43.936 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:43.979 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:44.060 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jwt. 2023-07-13T01:29:44.074 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-13T01:29:44.118 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:29:44.200 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2023-07-13T01:29:44.213 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-librgw2_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:44.258 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:44.318 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liboath0. 2023-07-13T01:29:44.331 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-13T01:29:44.379 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-13T01:29:44.430 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-13T01:29:44.443 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2023-07-13T01:29:44.462 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rgw. 2023-07-13T01:29:44.475 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:44.480 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-13T01:29:44.512 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:44.715 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libradosstriper1. 2023-07-13T01:29:44.731 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:44.759 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-underscore. 2023-07-13T01:29:44.768 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-13T01:29:44.773 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:44.809 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:29:44.840 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liboath0. 2023-07-13T01:29:44.854 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-13T01:29:44.890 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-13T01:29:45.087 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-13T01:29:45.095 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-13T01:29:45.127 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2023-07-13T01:29:45.137 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:29:45.141 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:45.185 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:45.226 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libradosstriper1. 2023-07-13T01:29:45.235 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-common. 2023-07-13T01:29:45.240 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:45.248 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../023-ceph-common_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:45.284 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:45.285 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:45.472 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0. 2023-07-13T01:29:45.485 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-13T01:29:45.507 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-routes. 2023-07-13T01:29:45.520 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2023-07-13T01:29:45.521 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-13T01:29:45.565 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-13T01:29:45.628 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-base. 2023-07-13T01:29:45.642 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../024-ceph-base_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:45.689 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:45.771 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-common. 2023-07-13T01:29:45.784 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../023-ceph-common_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:45.829 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:45.833 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2023-07-13T01:29:45.846 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:45.882 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:45.893 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-13T01:29:45.907 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:45.951 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:46.350 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2023-07-13T01:29:46.363 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-ceph-common_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:46.400 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:46.455 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-decorator. 2023-07-13T01:29:46.470 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-13T01:29:46.513 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:29:46.816 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-13T01:29:46.832 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-13T01:29:46.874 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:29:47.100 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-13T01:29:47.113 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-13T01:29:47.150 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:29:47.202 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-scipy. 2023-07-13T01:29:47.216 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-13T01:29:47.260 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-13T01:29:47.486 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-natsort. 2023-07-13T01:29:47.495 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-07-13T01:29:47.536 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-13T01:29:47.757 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-base. 2023-07-13T01:29:47.771 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../024-ceph-base_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:47.825 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:47.831 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-logutils. 2023-07-13T01:29:47.844 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-07-13T01:29:47.889 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-13T01:29:48.242 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-13T01:29:48.257 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-13T01:29:48.284 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-base. 2023-07-13T01:29:48.299 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../024-ceph-base_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:48.308 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:29:48.352 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:48.620 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-13T01:29:48.634 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-13T01:29:48.636 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-mako. 2023-07-13T01:29:48.649 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-13T01:29:48.686 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:29:48.687 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:29:48.915 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2023-07-13T01:29:48.923 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-ceph-base_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:48.967 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:49.014 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-13T01:29:49.023 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-13T01:29:49.064 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:29:49.219 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-13T01:29:49.235 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-13T01:29:49.274 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-joblib. 2023-07-13T01:29:49.277 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:29:49.287 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2023-07-13T01:29:49.332 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-13T01:29:49.351 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-13T01:29:49.360 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-13T01:29:49.402 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:29:49.615 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-natsort. 2023-07-13T01:29:49.628 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-07-13T01:29:49.673 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-13T01:29:49.679 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webob. 2023-07-13T01:29:49.687 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-13T01:29:49.711 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn. 2023-07-13T01:29:49.725 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-13T01:29:49.729 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-13T01:29:49.738 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-13T01:29:49.753 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-13T01:29:49.769 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:29:49.797 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:29:49.993 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-logutils. 2023-07-13T01:29:50.006 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-07-13T01:29:50.050 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-13T01:29:50.057 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-13T01:29:50.070 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-13T01:29:50.115 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:29:50.141 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-natsort. 2023-07-13T01:29:50.156 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-07-13T01:29:50.200 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-13T01:29:50.353 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-13T01:29:50.354 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-13T01:29:50.367 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-13T01:29:50.367 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-13T01:29:50.411 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:29:50.412 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:29:50.426 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bs4. 2023-07-13T01:29:50.441 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-07-13T01:29:50.485 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-13T01:29:50.494 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-13T01:29:50.508 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:50.519 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-logutils. 2023-07-13T01:29:50.535 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-07-13T01:29:50.552 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:50.577 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-13T01:29:50.681 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-mako. 2023-07-13T01:29:50.695 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-13T01:29:50.731 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:29:50.749 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2023-07-13T01:29:50.762 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2023-07-13T01:29:50.799 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-13T01:29:50.846 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-waitress. 2023-07-13T01:29:50.860 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-13T01:29:50.924 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:29:50.930 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-13T01:29:50.943 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-13T01:29:50.997 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:29:51.076 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-13T01:29:51.085 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2023-07-13T01:29:51.090 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-13T01:29:51.100 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2023-07-13T01:29:51.134 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:29:51.135 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-13T01:29:51.291 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-tempita. 2023-07-13T01:29:51.306 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-07-13T01:29:51.357 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-13T01:29:51.374 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-mako. 2023-07-13T01:29:51.387 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-13T01:29:51.420 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-13T01:29:51.421 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-13T01:29:51.435 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-13T01:29:51.436 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-13T01:29:51.440 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:29:51.478 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:29:51.479 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:29:51.702 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-paste. 2023-07-13T01:29:51.715 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-13T01:29:51.760 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:29:51.764 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cachetools. 2023-07-13T01:29:51.774 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-webob. 2023-07-13T01:29:51.780 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2023-07-13T01:29:51.787 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-13T01:29:51.791 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2023-07-13T01:29:51.804 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-13T01:29:51.822 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-13T01:29:51.832 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-13T01:29:51.841 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:29:51.853 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-13T01:29:51.867 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-13T01:29:51.912 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:29:52.105 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-13T01:29:52.118 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-13T01:29:52.125 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-13T01:29:52.140 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-13T01:29:52.159 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-13T01:29:52.161 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-13T01:29:52.171 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:29:52.174 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-13T01:29:52.175 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-13T01:29:52.192 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:29:52.214 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-13T01:29:52.219 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:29:52.228 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-13T01:29:52.234 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:29:52.272 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:29:52.481 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-13T01:29:52.483 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-13T01:29:52.495 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-bs4. 2023-07-13T01:29:52.496 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-13T01:29:52.498 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-13T01:29:52.504 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-07-13T01:29:52.539 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:29:52.541 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:29:52.545 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-13T01:29:52.545 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-13T01:29:52.559 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-13T01:29:52.603 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:29:52.617 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webob. 2023-07-13T01:29:52.630 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-13T01:29:52.683 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-13T01:29:52.859 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2023-07-13T01:29:52.873 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-13T01:29:52.878 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webtest. 2023-07-13T01:29:52.890 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-waitress. 2023-07-13T01:29:52.893 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-07-13T01:29:52.898 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-13T01:29:52.915 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rsa. 2023-07-13T01:29:52.917 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-13T01:29:52.929 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2023-07-13T01:29:52.942 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:29:52.944 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-13T01:29:52.973 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-13T01:29:53.086 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-13T01:29:53.100 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-13T01:29:53.152 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:29:53.251 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-tempita. 2023-07-13T01:29:53.261 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-13T01:29:53.266 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-07-13T01:29:53.276 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-13T01:29:53.293 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-google-auth. 2023-07-13T01:29:53.306 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2023-07-13T01:29:53.309 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-13T01:29:53.319 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:29:53.322 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pecan. 2023-07-13T01:29:53.337 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-13T01:29:53.351 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-13T01:29:53.388 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:29:53.472 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bs4. 2023-07-13T01:29:53.487 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-07-13T01:29:53.538 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-13T01:29:53.606 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bs4. 2023-07-13T01:29:53.612 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-paste. 2023-07-13T01:29:53.620 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2023-07-13T01:29:53.626 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-13T01:29:53.664 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-13T01:29:53.670 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:29:53.688 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-blinker. 2023-07-13T01:29:53.704 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-13T01:29:53.746 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:29:53.760 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-13T01:29:53.774 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-13T01:29:53.818 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:29:53.949 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-waitress. 2023-07-13T01:29:53.958 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-13T01:29:53.990 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-13T01:29:54.004 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-13T01:29:54.009 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2023-07-13T01:29:54.010 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:29:54.022 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-13T01:29:54.048 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:29:54.049 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-13T01:29:54.064 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-13T01:29:54.070 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:29:54.107 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:29:54.121 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-13T01:29:54.137 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:54.179 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:54.351 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-13T01:29:54.367 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-13T01:29:54.405 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2023-07-13T01:29:54.409 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:29:54.411 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempita. 2023-07-13T01:29:54.413 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-07-13T01:29:54.427 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2023-07-13T01:29:54.428 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-13T01:29:54.442 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-13T01:29:54.455 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-13T01:29:54.478 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-13T01:29:54.486 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:29:54.526 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-13T01:29:54.541 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:54.575 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:54.713 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-webtest. 2023-07-13T01:29:54.727 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-07-13T01:29:54.770 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-13T01:29:54.775 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2023-07-13T01:29:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-13T01:29:54.797 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-websocket. 2023-07-13T01:29:54.811 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-13T01:29:54.833 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:29:54.847 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-paste. 2023-07-13T01:29:54.855 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:29:54.863 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-13T01:29:54.914 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:29:54.920 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cryptography. 2023-07-13T01:29:54.934 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-13T01:29:54.979 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:29:55.082 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pecan. 2023-07-13T01:29:55.096 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-13T01:29:55.140 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:29:55.144 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-13T01:29:55.153 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-13T01:29:55.192 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-13T01:29:55.194 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:29:55.205 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-13T01:29:55.242 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-13T01:29:55.250 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:29:55.256 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-13T01:29:55.308 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:29:55.349 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-openssl. 2023-07-13T01:29:55.362 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-13T01:29:55.408 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-13T01:29:55.486 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-13T01:29:55.497 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-13T01:29:55.500 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-13T01:29:55.505 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-13T01:29:55.545 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:29:55.547 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:29:55.678 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-13T01:29:55.691 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-13T01:29:55.744 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:29:55.760 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr. 2023-07-13T01:29:55.774 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:55.818 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:55.839 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-13T01:29:55.850 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2023-07-13T01:29:55.853 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:55.860 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-07-13T01:29:55.897 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:55.900 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-13T01:29:55.925 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-13T01:29:55.939 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:55.983 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:56.072 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webtest. 2023-07-13T01:29:56.086 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2023-07-13T01:29:56.130 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-13T01:29:56.211 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2023-07-13T01:29:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-13T01:29:56.260 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-13T01:29:56.269 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:29:56.273 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:56.304 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mon. 2023-07-13T01:29:56.318 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:56.318 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-13T01:29:56.350 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2023-07-13T01:29:56.362 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:56.394 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:29:56.500 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pecan. 2023-07-13T01:29:56.513 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-13T01:29:56.558 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:29:56.604 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cryptography. 2023-07-13T01:29:56.613 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-13T01:29:56.645 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:29:56.649 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-13T01:29:56.664 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-13T01:29:56.707 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:29:56.756 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-13T01:29:56.772 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:29:56.814 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:29:56.921 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-13T01:29:56.934 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-13T01:29:56.974 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-openssl. 2023-07-13T01:29:56.979 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:29:56.983 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-13T01:29:57.011 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-13T01:29:57.016 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-13T01:29:57.025 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:57.069 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:57.092 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package jq. 2023-07-13T01:29:57.108 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:29:57.150 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:29:57.340 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-13T01:29:57.352 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr. 2023-07-13T01:29:57.355 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:29:57.366 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:57.398 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:57.410 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:57.411 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package socat. 2023-07-13T01:29:57.428 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2023-07-13T01:29:57.441 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-13T01:29:57.455 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:57.470 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-13T01:29:57.499 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:57.683 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-osd. 2023-07-13T01:29:57.696 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:57.741 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:57.786 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-13T01:29:57.799 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package xmlstarlet. 2023-07-13T01:29:57.800 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:57.812 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-13T01:29:57.827 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cryptography. 2023-07-13T01:29:57.841 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-13T01:29:57.844 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:57.857 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:29:57.885 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:29:57.896 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mon. 2023-07-13T01:29:57.905 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:57.946 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:58.164 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cryptography. 2023-07-13T01:29:58.177 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-13T01:29:58.204 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-test. 2023-07-13T01:29:58.213 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:29:58.220 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../087-ceph-test_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:58.262 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:58.264 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2023-07-13T01:29:58.280 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-13T01:29:58.322 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-13T01:29:58.667 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2023-07-13T01:29:58.681 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:58.725 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:58.874 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-openssl. 2023-07-13T01:29:58.887 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-13T01:29:58.933 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-13T01:29:59.220 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2023-07-13T01:29:59.225 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-osd. 2023-07-13T01:29:59.235 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:59.238 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:59.278 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:59.283 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:59.287 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr. 2023-07-13T01:29:59.302 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../047-ceph-mgr_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:59.345 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:29:59.823 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mon. 2023-07-13T01:29:59.837 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../048-ceph-mon_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:29:59.881 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:00.573 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2023-07-13T01:30:00.587 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:00.631 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:00.844 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph. 2023-07-13T01:30:00.857 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../050-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:00.902 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:01.201 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-osd. 2023-07-13T01:30:01.204 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-fuse. 2023-07-13T01:30:01.214 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../049-ceph-osd_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:01.218 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:01.259 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:01.262 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:01.707 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mds. 2023-07-13T01:30:01.721 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:01.765 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:02.158 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-volume. 2023-07-13T01:30:02.172 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../088-ceph-volume_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:02.216 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:02.251 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package cephadm. 2023-07-13T01:30:02.266 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../053-cephadm_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:02.309 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:02.336 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph. 2023-07-13T01:30:02.349 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../050-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:02.394 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:02.546 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-13T01:30:02.560 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:02.604 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:02.629 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-13T01:30:02.642 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-13T01:30:02.687 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:02.713 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-fuse. 2023-07-13T01:30:02.728 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:02.771 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:03.073 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jinja2. 2023-07-13T01:30:03.088 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-07-13T01:30:03.131 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:03.141 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-13T01:30:03.149 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mds. 2023-07-13T01:30:03.155 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../090-libcephfs-dev_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:03.163 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:03.199 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:03.199 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:03.426 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-13T01:30:03.439 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:03.484 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package nvme-cli. 2023-07-13T01:30:03.609 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2023-07-13T01:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-13T01:30:03.622 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:03.667 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:03.677 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:03.718 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package cephadm. 2023-07-13T01:30:03.734 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../053-cephadm_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:03.777 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:03.821 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-13T01:30:03.836 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-13T01:30:03.879 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:03.970 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2023-07-13T01:30:03.984 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:04.025 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-13T01:30:04.028 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:04.033 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../092-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-13T01:30:04.074 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-13T01:30:04.101 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-13T01:30:04.146 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:04.190 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-jwt. 2023-07-13T01:30:04.205 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-13T01:30:04.248 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:04.419 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-13T01:30:04.428 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph. 2023-07-13T01:30:04.429 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../093-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:04.442 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../050-ceph_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:04.469 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:04.473 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2023-07-13T01:30:04.486 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:04.487 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:04.515 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jinja2. 2023-07-13T01:30:04.531 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-07-13T01:30:04.533 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:04.543 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-13T01:30:04.557 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2023-07-13T01:30:04.574 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:04.592 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:04.805 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-fuse. 2023-07-13T01:30:04.819 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../051-ceph-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:04.855 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-13T01:30:04.883 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:04.926 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:04.946 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-underscore. 2023-07-13T01:30:04.955 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-13T01:30:05.275 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mds. 2023-07-13T01:30:05.288 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../052-ceph-mds_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:05.319 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:05.333 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:05.361 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-13T01:30:05.375 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-13T01:30:05.481 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:05.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2023-07-13T01:30:05.516 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-cephadm_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:05.560 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:05.647 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-13T01:30:05.660 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-13T01:30:05.705 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:05.767 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jwt. 2023-07-13T01:30:05.783 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-13T01:30:05.825 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:05.852 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephadm. 2023-07-13T01:30:05.866 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../053-cephadm_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:05.871 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-13T01:30:05.885 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-13T01:30:05.910 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:05.940 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:06.016 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-routes. 2023-07-13T01:30:06.030 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2023-07-13T01:30:06.074 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-13T01:30:06.120 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-13T01:30:06.134 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2023-07-13T01:30:06.178 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:06.205 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-13T01:30:06.219 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-13T01:30:06.263 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:06.308 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2023-07-13T01:30:06.309 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-13T01:30:06.321 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-07-13T01:30:06.326 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../094-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-13T01:30:06.366 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:06.367 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:06.377 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-13T01:30:06.393 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:06.430 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libjs-underscore. 2023-07-13T01:30:06.435 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:06.444 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-13T01:30:06.489 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:06.616 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jinja2. 2023-07-13T01:30:06.631 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2023-07-13T01:30:06.674 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:06.702 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-13T01:30:06.712 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-13T01:30:06.716 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:06.728 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../095-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-13T01:30:06.760 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:06.770 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:06.774 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-13T01:30:06.789 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-13T01:30:06.858 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:06.939 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-decorator. 2023-07-13T01:30:06.953 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-13T01:30:06.968 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-13T01:30:06.983 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:06.997 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:07.026 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:07.057 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-attr. 2023-07-13T01:30:07.072 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../096-python3-attr_19.3.0-2_all.deb ... 2023-07-13T01:30:07.097 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-13T01:30:07.110 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-13T01:30:07.114 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-13T01:30:07.155 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:07.160 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-routes. 2023-07-13T01:30:07.175 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2023-07-13T01:30:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-13T01:30:07.283 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-13T01:30:07.297 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-13T01:30:07.341 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:07.371 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-13T01:30:07.385 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-13T01:30:07.429 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:07.434 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webencodings. 2023-07-13T01:30:07.449 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../097-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-13T01:30:07.457 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jwt. 2023-07-13T01:30:07.466 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-13T01:30:07.492 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:07.507 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:07.538 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-13T01:30:07.552 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:07.596 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:07.627 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-scipy. 2023-07-13T01:30:07.640 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-13T01:30:07.669 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:07.757 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jwt. 2023-07-13T01:30:07.770 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-13T01:30:07.785 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-13T01:30:07.794 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2023-07-13T01:30:07.814 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:07.821 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-html5lib. 2023-07-13T01:30:07.835 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:07.836 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../098-python3-html5lib_1.0.1-2_all.deb ... 2023-07-13T01:30:07.879 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:08.091 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-decorator. 2023-07-13T01:30:08.104 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjs-underscore. 2023-07-13T01:30:08.105 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-13T01:30:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-13T01:30:08.126 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-13T01:30:08.142 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../059-python3-repoze.lru_0.7-2_all.deb ... 2023-07-13T01:30:08.149 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:08.154 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:08.184 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:08.215 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-13T01:30:08.230 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../099-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-13T01:30:08.273 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:08.435 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-13T01:30:08.436 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjs-underscore. 2023-07-13T01:30:08.440 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-13T01:30:08.448 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-13T01:30:08.450 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../060-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-13T01:30:08.450 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-13T01:30:08.490 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:08.493 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:08.495 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:08.762 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-packaging. 2023-07-13T01:30:08.772 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-13T01:30:08.776 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../100-python3-packaging_20.3-1_all.deb ... 2023-07-13T01:30:08.787 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../061-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-13T01:30:08.793 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2023-07-13T01:30:08.804 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-scipy. 2023-07-13T01:30:08.805 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2023-07-13T01:30:08.818 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-13T01:30:08.820 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-13T01:30:08.830 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:08.842 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-13T01:30:08.862 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:09.003 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-13T01:30:09.016 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-13T01:30:09.061 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:09.131 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastescript. 2023-07-13T01:30:09.133 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-routes. 2023-07-13T01:30:09.146 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../062-python3-routes_2.4.1-2_all.deb ... 2023-07-13T01:30:09.147 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2023-07-13T01:30:09.162 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-13T01:30:09.176 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:09.189 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:09.190 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-13T01:30:09.220 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:09.510 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pluggy. 2023-07-13T01:30:09.525 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../102-python3-pluggy_0.13.0-2_all.deb ... 2023-07-13T01:30:09.568 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:09.578 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-13T01:30:09.581 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-joblib. 2023-07-13T01:30:09.591 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../063-ceph-mgr-dashboard_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:09.596 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2023-07-13T01:30:09.630 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-13T01:30:09.635 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:09.723 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-decorator. 2023-07-13T01:30:09.737 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-13T01:30:09.781 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:09.890 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-psutil. 2023-07-13T01:30:09.905 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../103-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-13T01:30:09.948 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:10.026 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-sklearn. 2023-07-13T01:30:10.039 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-13T01:30:10.076 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-13T01:30:10.084 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:10.091 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-13T01:30:10.134 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:10.146 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-13T01:30:10.156 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-decorator. 2023-07-13T01:30:10.160 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-13T01:30:10.169 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../064-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-13T01:30:10.205 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:10.214 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:10.293 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-py. 2023-07-13T01:30:10.307 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../104-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-13T01:30:10.351 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:10.420 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-scipy. 2023-07-13T01:30:10.435 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-13T01:30:10.470 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:10.508 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-13T01:30:10.523 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../065-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-13T01:30:10.574 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:10.671 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-13T01:30:10.687 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-13T01:30:10.729 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:10.766 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-joblib. 2023-07-13T01:30:10.782 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2023-07-13T01:30:10.824 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-13T01:30:10.825 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-13T01:30:10.839 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:10.883 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:10.944 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-scipy. 2023-07-13T01:30:10.957 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../066-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-13T01:30:11.010 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:11.057 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-13T01:30:11.072 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../106-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-13T01:30:11.107 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:11.178 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-sklearn. 2023-07-13T01:30:11.192 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-13T01:30:11.235 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:11.410 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pytest. 2023-07-13T01:30:11.424 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../107-python3-pytest_4.6.9-1_all.deb ... 2023-07-13T01:30:11.467 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-13T01:30:11.804 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplejson. 2023-07-13T01:30:11.818 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-13T01:30:11.829 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-13T01:30:11.843 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-13T01:30:11.862 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:11.912 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:11.977 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-13T01:30:11.992 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:12.036 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-cachetools. 2023-07-13T01:30:12.052 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2023-07-13T01:30:12.060 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:12.111 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:12.140 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-13T01:30:12.154 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-13T01:30:12.198 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:12.302 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-13T01:30:12.316 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../067-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-13T01:30:12.360 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:12.372 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-13T01:30:12.385 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-13T01:30:12.430 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:12.432 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2023-07-13T01:30:12.445 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2023-07-13T01:30:12.481 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-13T01:30:12.741 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-13T01:30:12.757 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-13T01:30:12.799 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:12.810 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2023-07-13T01:30:12.825 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-13T01:30:12.868 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:12.902 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package radosgw. 2023-07-13T01:30:12.916 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../110-radosgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:12.930 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-joblib. 2023-07-13T01:30:12.939 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../068-python3-joblib_0.14.0-3_all.deb ... 2023-07-13T01:30:12.960 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:12.980 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-13T01:30:13.086 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-rsa. 2023-07-13T01:30:13.100 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2023-07-13T01:30:13.144 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-13T01:30:13.171 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cachetools. 2023-07-13T01:30:13.187 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2023-07-13T01:30:13.229 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:13.358 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn. 2023-07-13T01:30:13.372 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../069-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-13T01:30:13.416 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:13.455 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-google-auth. 2023-07-13T01:30:13.469 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2023-07-13T01:30:13.513 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-13T01:30:13.540 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-13T01:30:13.555 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-13T01:30:13.560 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-13T01:30:13.573 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:13.598 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:13.609 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:13.841 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-blinker. 2023-07-13T01:30:13.855 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-13T01:30:13.899 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:13.935 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-13T01:30:13.949 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-13T01:30:14.018 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:14.124 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-13T01:30:14.138 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../070-ceph-mgr-diskprediction-local_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:14.177 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-13T01:30:14.182 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:14.190 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-13T01:30:14.227 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:14.312 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rsa. 2023-07-13T01:30:14.327 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2023-07-13T01:30:14.355 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package rbd-fuse. 2023-07-13T01:30:14.369 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:14.370 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-13T01:30:14.413 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:14.547 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-13T01:30:14.562 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-13T01:30:14.605 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:14.691 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-google-auth. 2023-07-13T01:30:14.705 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2023-07-13T01:30:14.726 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-13T01:30:14.746 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2023-07-13T01:30:14.749 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-13T01:30:14.759 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2023-07-13T01:30:14.795 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:14.916 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-websocket. 2023-07-13T01:30:14.932 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-13T01:30:14.974 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:15.026 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:30:15.068 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-blinker. 2023-07-13T01:30:15.082 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-13T01:30:15.098 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-13T01:30:15.112 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-13T01:30:15.126 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:15.152 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:30:15.156 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:15.278 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:15.294 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-13T01:30:15.302 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cachetools. 2023-07-13T01:30:15.308 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-13T01:30:15.316 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../071-python3-cachetools_4.0.0-1_all.deb ... 2023-07-13T01:30:15.352 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:30:15.359 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:15.429 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-13T01:30:15.443 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-13T01:30:15.485 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-13T01:30:15.487 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:15.498 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-13T01:30:15.506 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:15.543 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:15.621 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-13T01:30:15.635 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../072-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-13T01:30:15.670 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:15.799 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-13T01:30:15.808 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-13T01:30:15.849 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:15.867 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2023-07-13T01:30:15.876 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2023-07-13T01:30:15.920 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-13T01:30:15.978 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-13T01:30:15.993 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:16.036 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:16.049 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-13T01:30:16.062 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../073-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-13T01:30:16.107 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:16.126 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user cephadm....done 2023-07-13T01:30:16.151 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-websocket. 2023-07-13T01:30:16.160 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-13T01:30:16.201 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:16.232 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2023-07-13T01:30:16.247 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2023-07-13T01:30:16.289 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-13T01:30:16.312 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:16.356 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-13T01:30:16.372 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2023-07-13T01:30:16.414 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:16.435 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rsa. 2023-07-13T01:30:16.438 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:30:16.448 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../074-python3-rsa_4.0-3_all.deb ... 2023-07-13T01:30:16.492 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-13T01:30:16.512 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-13T01:30:16.521 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-13T01:30:16.562 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:30:16.601 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-blinker. 2023-07-13T01:30:16.616 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-13T01:30:16.659 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:16.767 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-13T01:30:16.781 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:16.787 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-google-auth. 2023-07-13T01:30:16.798 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:16.802 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../075-python3-google-auth_1.5.1-2_all.deb ... 2023-07-13T01:30:16.825 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:16.845 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-13T01:30:16.962 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-13T01:30:16.975 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-13T01:30:17.020 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:17.083 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:17.103 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package jq. 2023-07-13T01:30:17.117 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:17.161 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:17.182 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-blinker. 2023-07-13T01:30:17.196 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../076-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-13T01:30:17.209 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-13T01:30:17.236 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-13T01:30:17.239 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:17.251 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:17.303 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:17.327 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:17.348 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-13T01:30:17.362 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-13T01:30:17.406 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:17.414 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package socat. 2023-07-13T01:30:17.428 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2023-07-13T01:30:17.472 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-13T01:30:17.542 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-13T01:30:17.556 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../077-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-13T01:30:17.600 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:17.645 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-13T01:30:17.689 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-13T01:30:17.702 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2023-07-13T01:30:17.734 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2023-07-13T01:30:17.747 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:17.750 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-13T01:30:17.792 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:17.793 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package xmlstarlet. 2023-07-13T01:30:17.806 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-13T01:30:17.850 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:17.929 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-13T01:30:17.943 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-13T01:30:17.987 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:18.048 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-13T01:30:18.104 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-13T01:30:18.115 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:18.117 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-13T01:30:18.162 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:30:18.167 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:18.230 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-test. 2023-07-13T01:30:18.245 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../087-ceph-test_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:18.288 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:18.298 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-websocket. 2023-07-13T01:30:18.313 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../079-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-13T01:30:18.340 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:18.356 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:18.453 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package jq. 2023-07-13T01:30:18.467 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:18.511 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:18.635 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:18.667 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-13T01:30:18.681 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../080-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-13T01:30:18.725 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:30:18.780 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package socat. 2023-07-13T01:30:18.789 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2023-07-13T01:30:18.802 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-13T01:30:18.818 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:18.830 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-13T01:30:18.860 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:18.896 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:19.159 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package xmlstarlet. 2023-07-13T01:30:19.172 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-13T01:30:19.172 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:19.173 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-13T01:30:19.185 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2023-07-13T01:30:19.217 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:19.229 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:19.357 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-13T01:30:19.372 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:19.415 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:19.580 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-test. 2023-07-13T01:30:19.594 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../087-ceph-test_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:19.625 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-13T01:30:19.632 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:30:19.638 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:19.639 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:19.683 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:19.760 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-13T01:30:19.773 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../082-libonig5_6.9.4-1_amd64.deb ... 2023-07-13T01:30:19.818 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:19.925 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:19.952 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2023-07-13T01:30:19.966 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:20.010 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:20.171 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-13T01:30:20.184 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../083-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:20.209 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:30:20.229 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:20.263 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2023-07-13T01:30:20.277 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2023-07-13T01:30:20.321 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-13T01:30:20.344 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:20.490 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package jq. 2023-07-13T01:30:20.506 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../084-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-13T01:30:20.548 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:20.617 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2023-07-13T01:30:20.631 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-13T01:30:20.675 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:20.695 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-13T01:30:20.803 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package socat. 2023-07-13T01:30:20.818 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../085-socat_1.7.3.3-2_amd64.deb ... 2023-07-13T01:30:20.860 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-13T01:30:20.955 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:21.021 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2023-07-13T01:30:21.034 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-ceph-test_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:21.079 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:21.172 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package xmlstarlet. 2023-07-13T01:30:21.187 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-13T01:30:21.230 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:21.239 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:21.557 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:21.577 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-test. 2023-07-13T01:30:21.590 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../087-ceph-test_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:21.635 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:21.850 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:22.100 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package ceph-volume. 2023-07-13T01:30:22.116 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../088-ceph-volume_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:22.158 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:22.185 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-13T01:30:22.478 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-13T01:30:22.480 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-13T01:30:22.496 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:22.538 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:22.754 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:30:22.880 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:22.989 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:23.058 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-13T01:30:23.073 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../090-libcephfs-dev_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:23.116 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:23.294 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:30:23.511 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package nvme-cli. 2023-07-13T01:30:23.525 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-13T01:30:23.574 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:23.575 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-volume. 2023-07-13T01:30:23.590 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../088-ceph-volume_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:23.633 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:23.704 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:30:23.890 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-13T01:30:23.905 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../092-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-13T01:30:23.948 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:23.963 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-13T01:30:23.977 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:24.021 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:24.073 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:30:24.343 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-13T01:30:24.358 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../093-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:24.401 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:24.441 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-13T01:30:24.566 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-13T01:30:24.568 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:24.582 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../090-libcephfs-dev_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:24.616 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:24.869 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:24.919 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package nvme-cli. 2023-07-13T01:30:24.933 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-13T01:30:24.985 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:25.003 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:25.008 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2023-07-13T01:30:25.022 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-ceph-volume_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:25.066 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:25.349 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-13T01:30:25.357 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:30:25.357 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../092-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-13T01:30:25.396 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-13T01:30:25.398 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:25.410 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:25.454 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-volume. 2023-07-13T01:30:25.482 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:25.486 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../088-ceph-volume_18.0.0-4093-g3990f91a-1focal_all.deb ... 2023-07-13T01:30:25.529 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:25.608 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:25.752 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-13T01:30:25.765 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../093-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:25.801 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:25.859 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-13T01:30:25.874 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../089-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:25.893 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:25.917 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:25.982 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-13T01:30:25.998 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-libcephfs-dev_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:26.040 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:26.087 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-13T01:30:26.105 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../094-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-13T01:30:26.154 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:26.202 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:26.328 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:30:26.412 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-13T01:30:26.427 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../090-libcephfs-dev_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:26.443 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2023-07-13T01:30:26.454 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:26.457 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-13T01:30:26.465 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-13T01:30:26.470 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:26.480 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../095-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-13T01:30:26.517 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:26.523 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:26.765 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:30:26.826 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-attr. 2023-07-13T01:30:26.840 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../096-python3-attr_19.3.0-2_all.deb ... 2023-07-13T01:30:26.848 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-13T01:30:26.862 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-13T01:30:26.865 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package nvme-cli. 2023-07-13T01:30:26.881 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../091-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-13T01:30:26.884 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-13T01:30:26.906 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:26.939 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:27.049 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-13T01:30:27.213 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-webencodings. 2023-07-13T01:30:27.229 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../097-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-13T01:30:27.249 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-13T01:30:27.265 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../092-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-13T01:30:27.271 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:27.276 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-13T01:30:27.291 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:27.307 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:27.334 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:27.342 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:30:27.468 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:30:27.495 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-13T01:30:27.512 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../094-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-13T01:30:27.561 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:27.574 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-html5lib. 2023-07-13T01:30:27.589 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../098-python3-html5lib_1.0.1-2_all.deb ... 2023-07-13T01:30:27.632 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:27.694 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-13T01:30:27.708 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../093-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-13T01:30:27.751 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:27.752 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-13T01:30:27.914 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-13T01:30:27.930 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../095-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-13T01:30:27.960 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-13T01:30:27.972 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:27.975 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../099-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-13T01:30:28.018 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:28.053 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:30:28.258 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-attr. 2023-07-13T01:30:28.273 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../096-python3-attr_19.3.0-2_all.deb ... 2023-07-13T01:30:28.317 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-13T01:30:28.362 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:28.513 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-packaging. 2023-07-13T01:30:28.529 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../100-python3-packaging_20.3-1_all.deb ... 2023-07-13T01:30:28.571 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-13T01:30:28.645 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-webencodings. 2023-07-13T01:30:28.659 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../097-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-13T01:30:28.702 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:28.795 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-13T01:30:28.853 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-13T01:30:28.869 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-13T01:30:28.874 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pastescript. 2023-07-13T01:30:28.889 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2023-07-13T01:30:28.911 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:28.932 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:28.998 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-html5lib. 2023-07-13T01:30:29.014 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../098-python3-html5lib_1.0.1-2_all.deb ... 2023-07-13T01:30:29.040 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:29.056 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:29.166 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:30:29.222 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-13T01:30:29.238 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-13T01:30:29.252 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pluggy. 2023-07-13T01:30:29.266 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../102-python3-pluggy_0.13.0-2_all.deb ... 2023-07-13T01:30:29.280 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:29.310 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:29.396 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-13T01:30:29.411 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../094-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-13T01:30:29.418 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-13T01:30:29.434 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../099-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-13T01:30:29.453 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:29.476 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:29.484 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:30:29.566 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-attr. 2023-07-13T01:30:29.582 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-python3-attr_19.3.0-2_all.deb ... 2023-07-13T01:30:29.605 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-psutil. 2023-07-13T01:30:29.619 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../103-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-13T01:30:29.624 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-13T01:30:29.663 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:29.799 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-13T01:30:29.814 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../095-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-13T01:30:29.844 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:29.929 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-packaging. 2023-07-13T01:30:29.945 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../100-python3-packaging_20.3-1_all.deb ... 2023-07-13T01:30:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webencodings. 2023-07-13T01:30:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-13T01:30:29.987 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:29.987 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-13T01:30:29.991 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-py. 2023-07-13T01:30:30.007 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../104-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-13T01:30:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:30.049 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:30.113 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-13T01:30:30.124 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:30.290 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pastescript. 2023-07-13T01:30:30.304 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2023-07-13T01:30:30.321 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-html5lib. 2023-07-13T01:30:30.338 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-python3-html5lib_1.0.1-2_all.deb ... 2023-07-13T01:30:30.348 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:30.352 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-13T01:30:30.368 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-13T01:30:30.379 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:30.410 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:30.418 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-attr. 2023-07-13T01:30:30.423 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:30.434 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../096-python3-attr_19.3.0-2_all.deb ... 2023-07-13T01:30:30.476 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-13T01:30:30.685 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pluggy. 2023-07-13T01:30:30.691 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:30.699 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-13T01:30:30.700 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../102-python3-pluggy_0.13.0-2_all.deb ... 2023-07-13T01:30:30.708 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-13T01:30:30.738 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-13T01:30:30.743 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:30.748 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:30.753 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../106-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-13T01:30:30.813 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:30.821 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webencodings. 2023-07-13T01:30:30.837 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../097-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-13T01:30:30.879 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:31.054 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-psutil. 2023-07-13T01:30:31.069 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../103-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-13T01:30:31.112 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:31.115 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-pytest. 2023-07-13T01:30:31.132 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../107-python3-pytest_4.6.9-1_all.deb ... 2023-07-13T01:30:31.165 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-13T01:30:31.206 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-html5lib. 2023-07-13T01:30:31.222 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../098-python3-html5lib_1.0.1-2_all.deb ... 2023-07-13T01:30:31.245 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-packaging. 2023-07-13T01:30:31.255 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-python3-packaging_20.3-1_all.deb ... 2023-07-13T01:30:31.264 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:31.295 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-13T01:30:31.440 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-py. 2023-07-13T01:30:31.455 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../104-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-13T01:30:31.498 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:31.527 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package python3-simplejson. 2023-07-13T01:30:31.543 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-13T01:30:31.585 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:31.609 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-13T01:30:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2023-07-13T01:30:31.625 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../099-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-13T01:30:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2023-07-13T01:30:31.667 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:31.673 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:31.812 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-13T01:30:31.826 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-13T01:30:31.863 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-13T01:30:31.870 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:31.880 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-13T01:30:31.921 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:31.994 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2023-07-13T01:30:32.003 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-python3-pluggy_0.13.0-2_all.deb ... 2023-07-13T01:30:32.044 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:32.120 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-packaging. 2023-07-13T01:30:32.135 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../100-python3-packaging_20.3-1_all.deb ... 2023-07-13T01:30:32.178 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-13T01:30:32.181 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-13T01:30:32.195 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../106-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-13T01:30:32.199 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:32.239 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:32.325 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-13T01:30:32.347 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2023-07-13T01:30:32.362 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-13T01:30:32.405 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:32.481 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastescript. 2023-07-13T01:30:32.498 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2023-07-13T01:30:32.539 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:32.542 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pytest. 2023-07-13T01:30:32.556 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../107-python3-pytest_4.6.9-1_all.deb ... 2023-07-13T01:30:32.591 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package radosgw. 2023-07-13T01:30:32.600 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-13T01:30:32.608 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../110-radosgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:32.649 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:32.693 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-13T01:30:32.741 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2023-07-13T01:30:32.756 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-13T01:30:32.799 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:32.884 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pluggy. 2023-07-13T01:30:32.898 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../102-python3-pluggy_0.13.0-2_all.deb ... 2023-07-13T01:30:32.950 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:32.978 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-simplejson. 2023-07-13T01:30:32.993 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-13T01:30:33.002 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:30:33.036 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:33.103 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-13T01:30:33.117 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-13T01:30:33.160 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:33.270 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-psutil. 2023-07-13T01:30:33.284 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../103-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-13T01:30:33.289 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-13T01:30:33.303 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-13T01:30:33.307 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:33.328 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:33.347 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:33.433 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-13T01:30:33.472 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-13T01:30:33.487 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-13T01:30:33.530 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:33.647 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-py. 2023-07-13T01:30:33.656 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../104-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-13T01:30:33.689 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:33.759 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:33.824 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2023-07-13T01:30:33.839 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pytest_4.6.9-1_all.deb ... 2023-07-13T01:30:33.882 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-13T01:30:34.000 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-13T01:30:34.009 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../105-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-13T01:30:34.018 INFO:teuthology.orchestra.run.smithi137.stdout:Selecting previously unselected package rbd-fuse. 2023-07-13T01:30:34.028 INFO:teuthology.orchestra.run.smithi137.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:34.034 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package radosgw. 2023-07-13T01:30:34.048 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../110-radosgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:34.049 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:34.068 INFO:teuthology.orchestra.run.smithi137.stdout:Unpacking rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:34.077 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:34.092 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:34.211 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2023-07-13T01:30:34.225 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-13T01:30:34.268 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:34.382 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-13T01:30:34.394 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-13T01:30:34.408 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../106-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-13T01:30:34.461 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:34.462 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:34.546 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-13T01:30:34.561 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-13T01:30:34.604 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:34.666 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:30:34.764 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pytest. 2023-07-13T01:30:34.771 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:34.778 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../107-python3-pytest_4.6.9-1_all.deb ... 2023-07-13T01:30:34.817 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:30:34.821 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-13T01:30:34.943 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:35.136 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:35.141 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplejson. 2023-07-13T01:30:35.157 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-13T01:30:35.199 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:35.333 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2023-07-13T01:30:35.348 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-radosgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:35.391 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:35.469 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-13T01:30:35.483 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-13T01:30:35.487 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package rbd-fuse. 2023-07-13T01:30:35.501 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:35.545 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:35.748 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user cephadm....done 2023-07-13T01:30:35.796 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:35.856 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-13T01:30:35.897 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:35.901 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:35.998 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:36.027 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:30:36.124 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-13T01:30:36.181 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package radosgw. 2023-07-13T01:30:36.195 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../110-radosgw_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:36.239 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:36.326 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:30:36.417 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:30:36.444 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:30:36.543 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-13T01:30:36.570 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:36.688 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:36.766 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2023-07-13T01:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:36.927 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:36.972 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:37.081 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-13T01:30:37.094 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:37.211 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:37.245 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-13T01:30:37.366 INFO:teuthology.orchestra.run.smithi022.stdout:Adding system user cephadm....done 2023-07-13T01:30:37.403 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:37.519 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:37.540 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:30:37.554 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-13T01:30:37.617 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package rbd-fuse. 2023-07-13T01:30:37.629 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:30:37.633 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../111-rbd-fuse_18.0.0-4093-g3990f91a-1focal_amd64.deb ... 2023-07-13T01:30:37.666 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:30:37.683 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:37.730 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:30:37.792 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:37.948 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:37.985 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:37.989 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:37.995 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-13T01:30:38.107 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librados2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:38.233 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:38.240 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:38.281 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:38.297 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-13T01:30:38.359 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:38.407 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-13T01:30:38.423 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-13T01:30:38.510 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:38.516 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:38.533 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:38.549 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-13T01:30:38.605 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2023-07-13T01:30:38.721 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:38.742 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:38.758 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:38.792 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:38.848 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-13T01:30:38.863 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-13T01:30:38.885 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:30:39.094 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:39.140 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:39.237 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:39.265 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:39.266 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-13T01:30:39.362 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user cephadm....done 2023-07-13T01:30:39.395 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:39.518 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:39.529 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:30:39.529 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:39.558 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:39.576 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librbd1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:39.644 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-13T01:30:39.655 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-13T01:30:39.702 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:39.781 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:39.813 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:39.828 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:39.842 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:39.987 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-13T01:30:40.050 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:30:40.050 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:30:40.099 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-13T01:30:40.114 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:30:40.127 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:40.241 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:40.313 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-13T01:30:40.428 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:40.439 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-13T01:30:40.493 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:40.513 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:40.557 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-13T01:30:40.617 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-13T01:30:40.648 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:40.721 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:40.770 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:40.773 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:30:40.847 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:30:40.875 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-13T01:30:40.910 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:41.105 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:41.139 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:41.186 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:41.277 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-13T01:30:41.380 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:41.423 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:30:41.537 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:41.549 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:41.570 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-13T01:30:41.673 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:41.702 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:41.805 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:41.820 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:41.863 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-13T01:30:41.934 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-13T01:30:41.946 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:41.974 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:42.088 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:42.100 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:30:42.136 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-13T01:30:42.147 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-13T01:30:42.211 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:42.223 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:42.384 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:42.420 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-13T01:30:42.440 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-argparse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:42.479 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:42.677 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:30:42.721 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:30:42.732 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:42.784 INFO:teuthology.orchestra.run.smithi103.stdout:Adding group ceph....done 2023-07-13T01:30:42.805 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:42.815 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:42.848 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:42.858 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-13T01:30:42.974 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:43.089 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:43.143 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-13T01:30:43.160 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user ceph....done 2023-07-13T01:30:43.207 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-13T01:30:43.250 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:30:43.337 INFO:teuthology.orchestra.run.smithi103.stdout:Setting system user ceph properties....done 2023-07-13T01:30:43.353 INFO:teuthology.orchestra.run.smithi103.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-13T01:30:43.427 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-13T01:30:43.432 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-13T01:30:43.498 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-13T01:30:43.500 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:43.548 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-13T01:30:43.676 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:30:43.728 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-13T01:30:43.768 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:43.811 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-13T01:30:43.907 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-13T01:30:44.021 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:30:44.046 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:30:44.111 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:44.147 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:44.183 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-13T01:30:44.272 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:44.291 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:44.395 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:44.407 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-13T01:30:44.417 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:44.468 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-13T01:30:44.532 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:44.566 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:30:44.682 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:30:44.682 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:30:44.730 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-13T01:30:44.794 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-13T01:30:44.850 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:44.967 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:30:44.985 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:45.022 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-13T01:30:45.087 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-13T01:30:45.323 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:30:45.327 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:30:45.336 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:30:45.360 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:45.423 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-13T01:30:45.449 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:45.462 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:45.575 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:45.588 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:45.706 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-13T01:30:45.707 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-13T01:30:45.727 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-13T01:30:45.831 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:45.868 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:30:45.873 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:46.002 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-13T01:30:46.128 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-13T01:30:46.149 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:46.190 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:46.220 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:46.254 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-13T01:30:46.270 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:30:46.316 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:30:46.325 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:46.442 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:46.462 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:30:46.462 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:30:46.547 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-13T01:30:46.622 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:30:46.685 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:30:46.769 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:30:46.803 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:46.929 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:46.930 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:46.940 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-13T01:30:46.990 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-13T01:30:47.053 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-13T01:30:47.141 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:47.154 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:30:47.155 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:30:47.221 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:47.299 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-13T01:30:47.346 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:30:47.459 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:47.471 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:30:47.539 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:47.597 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:47.624 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:47.659 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-13T01:30:47.665 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:30:47.756 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-13T01:30:47.794 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:47.799 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:47.940 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:30:48.049 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:30:48.066 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:48.112 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:48.117 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:30:48.118 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:30:48.142 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:30:48.192 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:48.246 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-13T01:30:48.375 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:48.435 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-13T01:30:48.493 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:48.584 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:48.597 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-13T01:30:48.709 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:48.715 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-13T01:30:48.720 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:30:48.739 INFO:teuthology.orchestra.run.smithi137.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-13T01:30:48.812 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:48.841 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-13T01:30:48.846 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:30:48.852 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:48.937 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:30:48.986 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:49.063 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:49.069 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:30:49.069 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:30:49.112 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:30:49.130 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-13T01:30:49.133 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-13T01:30:49.400 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:30:49.423 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:30:49.430 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:30:49.452 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:49.554 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:49.602 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-13T01:30:49.684 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-13T01:30:49.696 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:49.737 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-13T01:30:49.740 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:49.781 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:49.831 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:49.907 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:49.969 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:30:49.982 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:50.035 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-13T01:30:50.072 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-13T01:30:50.081 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-13T01:30:50.103 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:30:50.109 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:30:50.251 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-13T01:30:50.339 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-13T01:30:50.351 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:50.353 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:50.396 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-13T01:30:50.461 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:30:50.544 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:30:50.621 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:50.623 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-13T01:30:50.697 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:30:50.749 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-13T01:30:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:30:50.990 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:51.050 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-13T01:30:51.130 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:51.256 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:51.344 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-13T01:30:51.382 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-13T01:30:51.383 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-13T01:30:51.634 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:51.653 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-13T01:30:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:51.759 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:30:51.995 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:52.048 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-13T01:30:52.077 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:30:52.121 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:52.239 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-13T01:30:52.291 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-13T01:30:52.417 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-13T01:30:52.437 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:52.563 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:52.616 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-13T01:30:52.689 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-13T01:30:52.735 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-13T01:30:52.909 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:30:53.007 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:53.087 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-13T01:30:53.209 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:53.213 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-13T01:30:53.291 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:53.335 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-13T01:30:53.339 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-13T01:30:53.559 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:53.573 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-13T01:30:53.668 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-13T01:30:53.678 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:53.685 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-13T01:30:53.952 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-13T01:30:54.007 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:54.073 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-13T01:30:54.163 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-13T01:30:54.165 DEBUG:teuthology.parallel:result is None 2023-07-13T01:30:54.382 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:30:54.392 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:54.675 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:54.726 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:54.771 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:54.809 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-13T01:30:54.889 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-13T01:30:55.152 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:55.258 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-13T01:30:55.432 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:55.495 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:55.550 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:30:55.559 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-13T01:30:55.807 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:55.843 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:55.882 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:55.932 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:55.945 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-13T01:30:55.971 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-13T01:30:56.058 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:56.184 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-13T01:30:56.208 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:56.246 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-13T01:30:56.315 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:56.469 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:30:56.539 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-13T01:30:56.594 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-13T01:30:56.641 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:56.665 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-13T01:30:56.896 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:56.991 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-13T01:30:57.026 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:57.197 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:57.288 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:57.326 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-13T01:30:57.352 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:57.414 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:57.515 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:30:57.540 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:57.666 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-13T01:30:57.711 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-13T01:30:57.867 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librados2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:57.967 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:30:57.993 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:58.029 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-13T01:30:58.093 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-13T01:30:58.135 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:58.245 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:58.403 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:58.427 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:58.456 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:58.553 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:58.582 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-13T01:30:58.679 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:58.704 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:58.805 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-13T01:30:58.875 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.001 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-13T01:30:59.047 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:30:59.089 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:30:59.100 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-13T01:30:59.217 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-13T01:30:59.226 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-13T01:30:59.320 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up librbd1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.352 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-13T01:30:59.407 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librados2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.446 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.478 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-13T01:30:59.510 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:30:59.533 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:30:59.572 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.659 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.771 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-13T01:30:59.785 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:30:59.788 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:30:59.788 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:30:59.803 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-13T01:30:59.897 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-13T01:30:59.996 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.121 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:31:00.122 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-13T01:31:00.206 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-13T01:31:00.290 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.415 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.416 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.481 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.541 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-13T01:31:00.542 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:31:00.582 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-13T01:31:00.607 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:31:00.733 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.843 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librbd1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.859 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:00.969 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.079 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.095 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.133 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-13T01:31:01.205 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-13T01:31:01.323 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:31:01.323 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:31:01.471 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.489 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.494 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librados2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.597 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.607 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-13T01:31:01.620 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-13T01:31:01.722 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.746 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librgw2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.805 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.848 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.888 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.908 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.931 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:01.974 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:02.034 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:02.057 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:31:02.100 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs2 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:02.194 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:02.226 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-13T01:31:02.420 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:31:02.420 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:31:02.494 INFO:teuthology.orchestra.run.smithi137.stdout:Adding group ceph....done 2023-07-13T01:31:02.536 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libradosstriper1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:02.661 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-13T01:31:02.887 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:02.888 INFO:teuthology.orchestra.run.smithi137.stdout:Adding system user ceph....done 2023-07-13T01:31:02.955 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librbd1 (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.002 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.030 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.063 INFO:teuthology.orchestra.run.smithi137.stdout:Setting system user ceph properties....done 2023-07-13T01:31:03.078 INFO:teuthology.orchestra.run.smithi137.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-13T01:31:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-modules-core (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.103 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.156 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:31:03.206 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.228 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-13T01:31:03.229 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.355 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.422 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:31:03.423 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-13T01:31:03.481 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.538 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-13T01:31:03.850 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs-dev (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.976 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rados (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:03.992 INFO:teuthology.orchestra.run.smithi022.stdout:Adding group ceph....done 2023-07-13T01:31:04.025 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.109 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.110 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-13T01:31:04.151 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.243 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.370 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.377 INFO:teuthology.orchestra.run.smithi022.stdout:Adding system user ceph....done 2023-07-13T01:31:04.426 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:04.426 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:04.495 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.552 INFO:teuthology.orchestra.run.smithi022.stdout:Setting system user ceph properties....done 2023-07-13T01:31:04.574 INFO:teuthology.orchestra.run.smithi022.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-13T01:31:04.621 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:04.730 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-13T01:31:05.038 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rbd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.057 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-13T01:31:05.078 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.149 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2023-07-13T01:31:05.164 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up rbd-fuse (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.290 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.416 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cephfs (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.436 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-13T01:31:05.523 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.542 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-common (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.551 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2023-07-13T01:31:05.649 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.727 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2023-07-13T01:31:05.747 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-13T01:31:05.863 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:05.889 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-13T01:31:05.909 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:05.909 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:06.079 INFO:teuthology.orchestra.run.smithi084.stdout:Adding group ceph....done 2023-07-13T01:31:06.103 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:06.103 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:06.202 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-13T01:31:06.489 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user ceph....done 2023-07-13T01:31:06.548 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:06.593 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:06.664 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:06.664 INFO:teuthology.orchestra.run.smithi084.stdout:Setting system user ceph properties....done 2023-07-13T01:31:06.686 INFO:teuthology.orchestra.run.smithi084.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-13T01:31:06.776 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:06.777 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:06.790 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:06.836 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-13T01:31:07.137 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-13T01:31:07.145 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:07.145 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:07.235 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-13T01:31:07.491 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:07.585 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-test (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:07.711 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up radosgw (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:07.712 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:07.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:07.940 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:07.940 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:07.988 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:07.988 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-13T01:31:07.991 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:07.992 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:08.212 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-13T01:31:08.388 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:08.443 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:08.552 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:08.618 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:08.618 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:08.621 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-base (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:08.677 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:08.694 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:08.905 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:08.906 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:08.913 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:08.914 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:08.995 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-13T01:31:09.089 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.371 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.378 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.431 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mds (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.513 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.572 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:09.572 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:09.606 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:09.606 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:09.639 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.670 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:09.671 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-13T01:31:09.782 INFO:teuthology.orchestra.run.smithi137.stdout:Setting up ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:09.892 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:31:10.032 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:10.043 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-13T01:31:10.054 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:10.090 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:10.175 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:10.318 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:10.325 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:10.325 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-13T01:31:10.337 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:31:10.540 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:10.540 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:10.548 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:10.548 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:10.767 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-osd (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:10.997 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.019 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.123 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.145 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.235 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:11.235 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-13T01:31:11.254 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.258 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.397 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.464 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:11.464 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:11.524 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:31:11.660 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.675 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-13T01:31:11.787 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.917 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.929 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mon (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:11.968 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:31:12.060 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:12.151 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:12.152 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-13T01:31:12.186 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:12.425 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:12.572 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-cephadm (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:12.641 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:31:12.715 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:12.792 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-13T01:31:12.844 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-dashboard (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:12.986 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-volume (18.0.0-4093-g3990f91a-1focal) ... 2023-07-13T01:31:13.077 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:31:13.113 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-13T01:31:13.265 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-13T01:31:13.351 INFO:teuthology.orchestra.run.smithi137.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-13T01:31:13.533 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-13T01:31:13.937 INFO:teuthology.orchestra.run.smithi137.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-13T01:31:13.939 DEBUG:teuthology.parallel:result is None 2023-07-13T01:31:15.091 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-13T01:31:15.657 INFO:teuthology.orchestra.run.smithi022.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-13T01:31:15.660 DEBUG:teuthology.parallel:result is None 2023-07-13T01:31:16.129 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-13T01:31:16.577 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-13T01:31:16.722 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-13T01:31:16.725 DEBUG:teuthology.parallel:result is None 2023-07-13T01:31:17.173 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-13T01:31:17.176 DEBUG:teuthology.parallel:result is None 2023-07-13T01:31:17.176 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:17.480 DEBUG:teuthology.orchestra.run.smithi022:> dpkg-query -W -f '${Version}' ceph 2023-07-13T01:31:17.503 INFO:teuthology.orchestra.run.smithi022.stdout:18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:17.504 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:17.504 INFO:teuthology.task.install:The correct ceph version 18.0.0-4093-g3990f91a-1focal is installed. 2023-07-13T01:31:17.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:17.760 DEBUG:teuthology.orchestra.run.smithi084:> dpkg-query -W -f '${Version}' ceph 2023-07-13T01:31:17.783 INFO:teuthology.orchestra.run.smithi084.stdout:18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:17.784 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:17.784 INFO:teuthology.task.install:The correct ceph version 18.0.0-4093-g3990f91a-1focal is installed. 2023-07-13T01:31:17.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:18.054 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-query -W -f '${Version}' ceph 2023-07-13T01:31:18.076 INFO:teuthology.orchestra.run.smithi103.stdout:18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:18.077 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:18.077 INFO:teuthology.task.install:The correct ceph version 18.0.0-4093-g3990f91a-1focal is installed. 2023-07-13T01:31:18.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:18.382 DEBUG:teuthology.orchestra.run.smithi137:> dpkg-query -W -f '${Version}' ceph 2023-07-13T01:31:18.405 INFO:teuthology.orchestra.run.smithi137.stdout:18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:18.405 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:18.406 INFO:teuthology.task.install:The correct ceph version 18.0.0-4093-g3990f91a-1focal is installed. 2023-07-13T01:31:18.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:18.702 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2023-07-13T01:31:18.725 INFO:teuthology.orchestra.run.smithi154.stdout:18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:18.725 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4093-g3990f91a-1focal 2023-07-13T01:31:18.725 INFO:teuthology.task.install:The correct ceph version 18.0.0-4093-g3990f91a-1focal is installed. 2023-07-13T01:31:18.726 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-13T01:31:18.726 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:31:18.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T01:31:18.743 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:31:18.743 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T01:31:18.758 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:31:18.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T01:31:18.774 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:31:18.775 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T01:31:18.791 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:31:18.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-13T01:31:18.806 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-13T01:31:18.807 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:31:18.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T01:31:18.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T01:31:18.881 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:31:18.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T01:31:18.897 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T01:31:18.956 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:31:18.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T01:31:18.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T01:31:19.027 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:31:19.028 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T01:31:19.044 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T01:31:19.101 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:31:19.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-07-13T01:31:19.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-13T01:31:19.175 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-13T01:31:19.175 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:31:19.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T01:31:19.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T01:31:19.249 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:31:19.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T01:31:19.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T01:31:19.320 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:31:19.320 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T01:31:19.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T01:31:19.393 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:31:19.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T01:31:19.410 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T01:31:19.465 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:31:19.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-13T01:31:19.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-13T01:31:19.538 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-13T01:31:19.539 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:31:19.539 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T01:31:19.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T01:31:19.613 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:31:19.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T01:31:19.629 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T01:31:19.685 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:31:19.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T01:31:19.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T01:31:19.757 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:31:19.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T01:31:19.773 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T01:31:19.830 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:31:19.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2023-07-13T01:31:19.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-13T01:31:19.908 INFO:teuthology.run_tasks:Running task cephadm... 2023-07-13T01:31:20.001 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': False}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '3990f91ac125621431ef1b77c2fc96421bec9e51'} 2023-07-13T01:31:20.002 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:20.012 INFO:tasks.cephadm:Cluster fsid is f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:31:20.013 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-07-13T01:31:20.014 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.22', 'mon.b': '172.21.15.84', 'mon.c': '172.21.15.103', 'mon.d': '172.21.15.137', 'mon.e': '172.21.15.154'} 2023-07-13T01:31:20.014 INFO:tasks.cephadm:First mon is mon.a on smithi022 2023-07-13T01:31:20.014 INFO:tasks.cephadm:First mgr is a 2023-07-13T01:31:20.014 INFO:tasks.cephadm:Normalizing hostnames... 2023-07-13T01:31:20.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2023-07-13T01:31:20.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2023-07-13T01:31:20.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2023-07-13T01:31:20.062 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname $(hostname -s) 2023-07-13T01:31:20.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2023-07-13T01:31:20.094 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-07-13T01:31:20.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:20.320 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3990f91ac125621431ef1b77c2fc96421bec9e51', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=focal,DIST=focal,MACHINE_SIZE=gigantic/71346/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-4093-g3990f91a', 'node_name': '172.21.2.10+braggi10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=focal,DIST=focal,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-4093-g3990f91a-1focal'}, 'url': 'https://1.chacra.ceph.com/r/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/', 'distro_codename': 'focal', 'modified': '2023-07-12 16:05:00.242689', 'distro_version': '20.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'cv-refactor-osd-objectstore', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2023-07-13T01:31:20.545 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref cv-refactor-osd-objectstore, sha1 3990f91ac125621431ef1b77c2fc96421bec9e51 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F20.04%2Fx86_64&flavor=default&sha1=3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:20.546 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/x86_64/flavors/default/cephadm 2023-07-13T01:31:20.546 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:21.925 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-rw-r-- 1 ubuntu ubuntu 199436 Jul 13 01:31 /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:21.926 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:22.702 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-rw-r-- 1 ubuntu ubuntu 199436 Jul 13 01:31 /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:22.703 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:23.487 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-rw-r-- 1 ubuntu ubuntu 199436 Jul 13 01:31 /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:23.488 DEBUG:teuthology.orchestra.run.smithi137:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:24.367 INFO:teuthology.orchestra.run.smithi137.stdout:-rw-rw-r-- 1 ubuntu ubuntu 199436 Jul 13 01:31 /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:24.367 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/cv-refactor-osd-objectstore/3990f91ac125621431ef1b77c2fc96421bec9e51/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.200 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-rw-r-- 1 ubuntu ubuntu 199436 Jul 13 01:31 /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.200 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.210 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.219 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.228 DEBUG:teuthology.orchestra.run.smithi137:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.237 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-13T01:31:25.260 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 on all hosts... 2023-07-13T01:31:25.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 pull 2023-07-13T01:31:25.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 pull 2023-07-13T01:31:25.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 pull 2023-07-13T01:31:25.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 pull 2023-07-13T01:31:25.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 pull 2023-07-13T01:31:25.469 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51... 2023-07-13T01:31:25.490 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51... 2023-07-13T01:31:25.495 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51... 2023-07-13T01:31:25.502 INFO:teuthology.orchestra.run.smithi137.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51... 2023-07-13T01:31:25.514 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51... 2023-07-13T01:31:51.474 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-07-13T01:31:51.475 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev)", 2023-07-13T01:31:51.475 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "73a6258f4ccfe5185d6cb87618672f07c1383d92c314b483a75698120bc3fb10", 2023-07-13T01:31:51.475 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2023-07-13T01:31:51.475 INFO:teuthology.orchestra.run.smithi084.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ecb2a0d10580384097b40b3f7ddffe0f65be8ae7a193e786b3e04c9f6ee2e9" 2023-07-13T01:31:51.475 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-07-13T01:31:51.475 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-07-13T01:31:51.829 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2023-07-13T01:31:51.830 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev)", 2023-07-13T01:31:51.830 INFO:teuthology.orchestra.run.smithi137.stdout: "image_id": "73a6258f4ccfe5185d6cb87618672f07c1383d92c314b483a75698120bc3fb10", 2023-07-13T01:31:51.830 INFO:teuthology.orchestra.run.smithi137.stdout: "repo_digests": [ 2023-07-13T01:31:51.830 INFO:teuthology.orchestra.run.smithi137.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ecb2a0d10580384097b40b3f7ddffe0f65be8ae7a193e786b3e04c9f6ee2e9" 2023-07-13T01:31:51.830 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2023-07-13T01:31:51.830 INFO:teuthology.orchestra.run.smithi137.stdout:} 2023-07-13T01:31:52.249 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2023-07-13T01:31:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev)", 2023-07-13T01:31:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "73a6258f4ccfe5185d6cb87618672f07c1383d92c314b483a75698120bc3fb10", 2023-07-13T01:31:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2023-07-13T01:31:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ecb2a0d10580384097b40b3f7ddffe0f65be8ae7a193e786b3e04c9f6ee2e9" 2023-07-13T01:31:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2023-07-13T01:31:52.250 INFO:teuthology.orchestra.run.smithi103.stdout:} 2023-07-13T01:31:53.039 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-07-13T01:31:53.039 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev)", 2023-07-13T01:31:53.039 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "73a6258f4ccfe5185d6cb87618672f07c1383d92c314b483a75698120bc3fb10", 2023-07-13T01:31:53.040 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2023-07-13T01:31:53.040 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ecb2a0d10580384097b40b3f7ddffe0f65be8ae7a193e786b3e04c9f6ee2e9" 2023-07-13T01:31:53.040 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-07-13T01:31:53.040 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-07-13T01:31:53.101 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-07-13T01:31:53.101 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev)", 2023-07-13T01:31:53.101 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "73a6258f4ccfe5185d6cb87618672f07c1383d92c314b483a75698120bc3fb10", 2023-07-13T01:31:53.101 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2023-07-13T01:31:53.101 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ecb2a0d10580384097b40b3f7ddffe0f65be8ae7a193e786b3e04c9f6ee2e9" 2023-07-13T01:31:53.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-07-13T01:31:53.102 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-07-13T01:31:53.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2023-07-13T01:31:53.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2023-07-13T01:31:53.157 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2023-07-13T01:31:53.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph 2023-07-13T01:31:53.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2023-07-13T01:31:53.207 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2023-07-13T01:31:53.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2023-07-13T01:31:53.237 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2023-07-13T01:31:53.251 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /etc/ceph 2023-07-13T01:31:53.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2023-07-13T01:31:53.279 INFO:tasks.cephadm:Writing seed config... 2023-07-13T01:31:53.280 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2023-07-13T01:31:53.280 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-07-13T01:31:53.280 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-07-13T01:31:53.281 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = False 2023-07-13T01:31:53.281 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-07-13T01:31:53.281 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-07-13T01:31:53.281 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-07-13T01:31:53.281 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-07-13T01:31:53.282 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-07-13T01:31:53.282 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:31:53.283 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-07-13T01:31:53.289 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f81712b0-211c-11ee-9b31-001a4aab830c mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = False [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2023-07-13T01:31:53.290 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a.service 2023-07-13T01:31:53.334 DEBUG:teuthology.orchestra.run.smithi022:mgr.a> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a.service 2023-07-13T01:31:53.377 INFO:tasks.cephadm:Bootstrapping... 2023-07-13T01:31:53.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 -v bootstrap --fsid f81712b0-211c-11ee-9b31-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-07-13T01:31:53.544 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-07-13T01:31:53.545 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51', '-v', 'bootstrap', '--fsid', 'f81712b0-211c-11ee-9b31-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.22', '--skip-admin-label'] 2023-07-13T01:31:53.545 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-07-13T01:31:53.545 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2023-07-13T01:31:53.546 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2023-07-13T01:31:53.546 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2023-07-13T01:31:53.551 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-13T01:31:53.551 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-13T01:31:53.557 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-13T01:31:53.557 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.562 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2023-07-13T01:31:53.562 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2023-07-13T01:31:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2023-07-13T01:31:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.574 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2023-07-13T01:31:53.574 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout masked 2023-07-13T01:31:53.579 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2023-07-13T01:31:53.580 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.584 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2023-07-13T01:31:53.584 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2023-07-13T01:31:53.589 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2023-07-13T01:31:53.590 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.595 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2023-07-13T01:31:53.600 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2023-07-13T01:31:53.600 INFO:teuthology.orchestra.run.smithi022.stdout:Unit ntp.service is enabled and running 2023-07-13T01:31:53.600 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2023-07-13T01:31:53.600 INFO:teuthology.orchestra.run.smithi022.stdout:docker (/usr/bin/docker) is present 2023-07-13T01:31:53.600 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2023-07-13T01:31:53.600 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2023-07-13T01:31:53.605 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-13T01:31:53.605 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-13T01:31:53.610 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-13T01:31:53.610 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.615 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2023-07-13T01:31:53.616 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2023-07-13T01:31:53.619 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2023-07-13T01:31:53.620 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.625 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2023-07-13T01:31:53.625 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout masked 2023-07-13T01:31:53.631 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2023-07-13T01:31:53.631 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.637 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2023-07-13T01:31:53.637 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2023-07-13T01:31:53.643 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2023-07-13T01:31:53.643 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2023-07-13T01:31:53.649 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2023-07-13T01:31:53.655 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2023-07-13T01:31:53.655 INFO:teuthology.orchestra.run.smithi022.stdout:Unit ntp.service is enabled and running 2023-07-13T01:31:53.655 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2023-07-13T01:31:53.655 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:31:53.656 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 140465333433968 on /run/cephadm/f81712b0-211c-11ee-9b31-001a4aab830c.lock 2023-07-13T01:31:53.656 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 140465333433968 acquired on /run/cephadm/f81712b0-211c-11ee-9b31-001a4aab830c.lock 2023-07-13T01:31:53.656 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 3300 ... 2023-07-13T01:31:53.656 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2023-07-13T01:31:53.657 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:3300, 172.21.15.22:6789], mon addrv is [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2023-07-13T01:31:53.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2023-07-13T01:31:53.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2023-07-13T01:31:53.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 2023-07-13T01:31:53.665 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-07-13T01:31:53.665 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-07-13T01:31:53.665 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1772sec hoplimit 64 pref medium 2023-07-13T01:31:53.668 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-07-13T01:31:53.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2023-07-13T01:31:53.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-13T01:31:53.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-07-13T01:31:53.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-07-13T01:31:53.669 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-13T01:31:53.670 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2023-07-13T01:31:53.670 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2023-07-13T01:31:53.670 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-07-13T01:31:53.670 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-07-13T01:31:53.671 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51... 2023-07-13T01:31:53.793 INFO:journalctl@ceph.mon.a.smithi022.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:31:53.836 INFO:journalctl@ceph.mgr.a.smithi022.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:31:53.934 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/docker: stdout 3990f91ac125621431ef1b77c2fc96421bec9e51: Pulling from ceph-ci/ceph 2023-07-13T01:31:53.935 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/docker: stdout Digest: sha256:45ecb2a0d10580384097b40b3f7ddffe0f65be8ae7a193e786b3e04c9f6ee2e9 2023-07-13T01:31:53.935 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:53.935 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 2023-07-13T01:31:55.660 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev) 2023-07-13T01:31:55.660 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev) 2023-07-13T01:31:55.661 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2023-07-13T01:31:57.156 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2023-07-13T01:31:57.157 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2023-07-13T01:31:58.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQAOVK9k8WVEBBAAT5zDwlN4wqto6ruORRyOvw== 2023-07-13T01:32:00.215 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQAPVK9kFhOKIhAALR9HGUNtZFrb+9e7oVYWoQ== 2023-07-13T01:32:01.706 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQARVK9kGym3BhAAIQmON6EO6hu/VkPv5M3rEQ== 2023-07-13T01:32:01.707 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2023-07-13T01:32:03.267 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-13T01:32:03.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-07-13T01:32:03.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:03.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-13T01:32:03.268 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v2:172.21.15.22:3300,v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-13T01:32:03.269 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = pacific 2023-07-13T01:32:03.269 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:03.269 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-13T01:32:03.269 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:32:03.269 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2023-07-13T01:32:04.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.217+0000 7eff30da9c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-13T01:32:04.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.217+0000 7eff30da9c80 1 imported monmap: 2023-07-13T01:32:04.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr epoch 0 2023-07-13T01:32:04.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:04.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr last_changed 2023-07-13T01:32:02.659334+0000 2023-07-13T01:32:04.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr created 2023-07-13T01:32:02.659334+0000 2023-07-13T01:32:04.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr min_mon_release 16 (pacific) 2023-07-13T01:32:04.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2023-07-13T01:32:04.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2023-07-13T01:32:04.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.217+0000 7eff30da9c80 0 /usr/bin/ceph-mon: set fsid to f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:04.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: RocksDB version: 7.9.2 2023-07-13T01:32:04.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Git sha 0 2023-07-13T01:32:04.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Compile date 2023-07-12 14:33:48 2023-07-13T01:32:04.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: DB SUMMARY 2023-07-13T01:32:04.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: DB Session ID: 9X6TWHFMC4FJ6TISBE7B 2023-07-13T01:32:04.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2023-07-13T01:32:04.825 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2023-07-13T01:32:04.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.error_if_exists: 0 2023-07-13T01:32:04.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.create_if_missing: 1 2023-07-13T01:32:04.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.paranoid_checks: 1 2023-07-13T01:32:04.826 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-07-13T01:32:04.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-13T01:32:04.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-13T01:32:04.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.env: 0x55a8b5b4a720 2023-07-13T01:32:04.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.fs: PosixFileSystem 2023-07-13T01:32:04.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.info_log: 0x55a8b8c4c600 2023-07-13T01:32:04.827 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.statistics: (nil) 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.use_fsync: 0 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_log_file_size: 0 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-13T01:32:04.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.allow_fallocate: 1 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.use_direct_reads: 0 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.create_missing_column_families: 0 2023-07-13T01:32:04.829 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.db_log_dir: 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.wal_dir: 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-13T01:32:04.830 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.advise_random_on_open: 1 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.write_buffer_manager: 0x55a8b7edcd20 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.rate_limiter: (nil) 2023-07-13T01:32:04.831 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-13T01:32:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-13T01:32:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-13T01:32:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-13T01:32:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.unordered_write: 0 2023-07-13T01:32:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-13T01:32:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.row_cache: None 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.wal_filter: None 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-13T01:32:04.833 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.two_write_queues: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.manual_wal_flush: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.wal_compression: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.atomic_flush: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-13T01:32:04.834 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.log_readahead_size: 0 2023-07-13T01:32:04.835 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-13T01:32:04.835 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-07-13T01:32:04.835 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-13T01:32:04.835 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-13T01:32:04.835 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-07-13T01:32:04.836 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-07-13T01:32:04.836 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-07-13T01:32:04.836 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_background_jobs: 2 2023-07-13T01:32:04.836 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_background_compactions: -1 2023-07-13T01:32:04.837 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_subcompactions: 1 2023-07-13T01:32:04.837 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-13T01:32:04.837 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-13T01:32:04.837 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-13T01:32:04.838 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_total_wal_size: 0 2023-07-13T01:32:04.838 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-13T01:32:04.838 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-13T01:32:04.838 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-13T01:32:04.838 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-13T01:32:04.838 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_open_files: -1 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bytes_per_sync: 0 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_background_flushes: -1 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Compression algorithms supported: 2023-07-13T01:32:04.839 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kZSTD supported: 0 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kXpressCompression supported: 0 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kZlibCompression supported: 1 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kSnappyCompression supported: 1 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kLZ4Compression supported: 1 2023-07-13T01:32:04.840 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: kBZip2Compression supported: 0 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.merge_operator: 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_filter: None 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_filter_factory: None 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-07-13T01:32:04.842 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-13T01:32:04.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-13T01:32:04.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a8b8c4c700) 2023-07-13T01:32:04.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2023-07-13T01:32:04.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2023-07-13T01:32:04.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-13T01:32:04.843 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2023-07-13T01:32:04.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x55a8b7f5f1f0 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2023-07-13T01:32:04.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2023-07-13T01:32:04.846 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2023-07-13T01:32:04.847 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-13T01:32:04.848 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression: NoCompression 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.num_levels: 7 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-13T01:32:04.849 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-13T01:32:04.850 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.level: 32767 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-13T01:32:04.851 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.enabled: false 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-13T01:32:04.852 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-13T01:32:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-13T01:32:04.854 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.arena_block_size: 1048576 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-13T01:32:04.855 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-13T01:32:04.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-13T01:32:04.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-13T01:32:04.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-13T01:32:04.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-13T01:32:04.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-13T01:32:04.856 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.table_properties_collectors: 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.inplace_update_support: 0 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-13T01:32:04.857 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.bloom_locality: 0 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.max_successive_merges: 0 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.force_consistency_checks: 1 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.ttl: 2592000 2023-07-13T01:32:04.858 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-13T01:32:04.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-13T01:32:04.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-13T01:32:04.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.enable_blob_files: false 2023-07-13T01:32:04.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.min_blob_size: 0 2023-07-13T01:32:04.859 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.blob_file_size: 268435456 2023-07-13T01:32:04.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-07-13T01:32:04.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-07-13T01:32:04.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-13T01:32:04.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-13T01:32:04.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-13T01:32:04.860 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-07-13T01:32:04.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-13T01:32:04.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-13T01:32:04.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-13T01:32:04.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.861 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fbe4c050-9354-4b8f-bb18-0282f0f05e39 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.221+0000 7eff30da9c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff30da9c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a8b7fd6000 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff30da9c80 4 rocksdb: DB pointer 0x55a8b7fc8000 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff20fc0700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-13T01:32:04.862 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff20fc0700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-13T01:32:04.863 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-07-13T01:32:04.864 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-13T01:32:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.866 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:32:04.866 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2023-07-13T01:32:04.866 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2023-07-13T01:32:04.866 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2023-07-13T01:32:04.866 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x55a8b7f5f1f0#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2023-07-13T01:32:04.867 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2023-07-13T01:32:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr 2023-07-13T01:32:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff30da9c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2023-07-13T01:32:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff30da9c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2023-07-13T01:32:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-mon: stderr debug 2023-07-13T01:32:04.225+0000 7eff30da9c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2023-07-13T01:32:04.868 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2023-07-13T01:32:05.035 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-07-13T01:32:05.235 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2023-07-13T01:32:05.445 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f81712b0-211c-11ee-9b31-001a4aab830c.target -> /etc/systemd/system/ceph-f81712b0-211c-11ee-9b31-001a4aab830c.target. 2023-07-13T01:32:05.445 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f81712b0-211c-11ee-9b31-001a4aab830c.target -> /etc/systemd/system/ceph-f81712b0-211c-11ee-9b31-001a4aab830c.target. 2023-07-13T01:32:05.659 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a 2023-07-13T01:32:05.659 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a.service: Unit ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a.service not loaded. 2023-07-13T01:32:05.862 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f81712b0-211c-11ee-9b31-001a4aab830c.target.wants/ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-f81712b0-211c-11ee-9b31-001a4aab830c@.service. 2023-07-13T01:32:05.874 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld does not appear to be present 2023-07-13T01:32:05.875 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2023-07-13T01:32:05.875 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2023-07-13T01:32:05.875 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2023-07-13T01:32:07.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:07 smithi022 bash[26443]: cluster 1689211927.4333262 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2023-07-13T01:32:08.307 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2023-07-13T01:32:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:08.308 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-07-13T01:32:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2023-07-13T01:32:08.309 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.242017s) 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-07-13T01:32:08.310 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2023-07-13T01:32:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2023-07-13T01:32:08.311 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2023-07-13T01:32:08.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:08 smithi022 bash[26443]: cluster 1689211927.4369867 mon.a (mon.0) 2 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2023-07-13T01:32:08.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:08 smithi022 bash[26443]: cluster 1689211927.4371731 mon.a (mon.0) 3 : cluster 0 monmap e1: 1 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0]} removed_ranks: {} 2023-07-13T01:32:08.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:08 smithi022 bash[26443]: cluster 1689211927.4396672 mon.a (mon.0) 4 : cluster 0 fsmap 2023-07-13T01:32:08.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:08 smithi022 bash[26443]: cluster 1689211927.4425964 mon.a (mon.0) 5 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2023-07-13T01:32:08.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:08 smithi022 bash[26443]: cluster 1689211927.4431477 mon.a (mon.0) 6 : cluster 0 mgrmap e1: no daemons active 2023-07-13T01:32:08.680 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:08 smithi022 bash[26443]: audit 1689211927.6789305 mon.a (mon.0) 7 : audit 0 from='client.? 172.21.15.22:0/1791906935' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-07-13T01:32:09.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:09 smithi022 bash[26443]: audit 1689211929.593556 mon.a (mon.0) 8 : audit 1 from='client.? 172.21.15.22:0/4291584651' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-13T01:32:09.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:09 smithi022 bash[26443]: audit 1689211929.5998816 mon.a (mon.0) 9 : audit 1 from='client.? 172.21.15.22:0/4291584651' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-13T01:32:10.234 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:10.234 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2023-07-13T01:32:10.234 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:10.235 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = False 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-13T01:32:10.236 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2023-07-13T01:32:11.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:11 smithi022 bash[26443]: audit 1689211931.42202 mon.a (mon.0) 10 : audit 0 from='client.? 172.21.15.22:0/421874574' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:32:12.036 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2023-07-13T01:32:12.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 systemd[1]: Stopping Ceph mon.a for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T01:32:12.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 bash[26443]: debug 2023-07-13T01:32:12.213+0000 7f1d2eb1a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-13T01:32:12.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 bash[26443]: debug 2023-07-13T01:32:12.213+0000 7f1d2eb1a700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-13T01:32:12.951 INFO:teuthology.orchestra.run.smithi022.stdout:Setting mon public_network to 172.21.0.0/20 2023-07-13T01:32:13.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 bash[26867]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c-mon-a 2023-07-13T01:32:13.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a.service: Succeeded. 2023-07-13T01:32:13.179 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 systemd[1]: Stopped Ceph mon.a for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:32:13.179 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:12 smithi022 systemd[1]: Started Ceph mon.a for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:32:14.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.257+0000 7f1bbeb12c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-13T01:32:14.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.257+0000 7f1bbeb12c80 0 ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev), process ceph-mon, pid 7 2023-07-13T01:32:14.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.257+0000 7f1bbeb12c80 0 pidfile_write: ignore empty --pid-file 2023-07-13T01:32:14.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 0 load: jerasure load: lrc 2023-07-13T01:32:14.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: RocksDB version: 7.9.2 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Git sha 0 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Compile date 2023-07-12 14:33:48 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: DB SUMMARY 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: DB Session ID: YRJQHGAAR9W2JCMB5ANA 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: CURRENT file: CURRENT 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: IDENTITY file: IDENTITY 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-07-13T01:32:14.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 83630 ; 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.error_if_exists: 0 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.create_if_missing: 0 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.paranoid_checks: 1 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-13T01:32:14.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.env: 0x55d716fa5720 2023-07-13T01:32:14.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.fs: PosixFileSystem 2023-07-13T01:32:14.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.info_log: 0x55d719c593c0 2023-07-13T01:32:14.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-13T01:32:14.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.statistics: (nil) 2023-07-13T01:32:14.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.use_fsync: 0 2023-07-13T01:32:14.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_log_file_size: 0 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.allow_fallocate: 1 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-13T01:32:14.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.use_direct_reads: 0 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.create_missing_column_families: 0 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.db_log_dir: 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.wal_dir: 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-13T01:32:14.435 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.advise_random_on_open: 1 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.write_buffer_manager: 0x55d718ee85a0 2023-07-13T01:32:14.436 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.rate_limiter: (nil) 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-13T01:32:14.437 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.unordered_write: 0 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.row_cache: None 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.wal_filter: None 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-13T01:32:14.438 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.two_write_queues: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.manual_wal_flush: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.wal_compression: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.atomic_flush: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-13T01:32:14.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.log_readahead_size: 0 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-07-13T01:32:14.440 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_background_jobs: 2 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_background_compactions: -1 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_subcompactions: 1 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_total_wal_size: 0 2023-07-13T01:32:14.441 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_open_files: -1 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bytes_per_sync: 0 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-13T01:32:14.442 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_background_flushes: -1 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Compression algorithms supported: 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kZSTD supported: 0 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kXpressCompression supported: 0 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kZlibCompression supported: 1 2023-07-13T01:32:14.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kSnappyCompression supported: 1 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kLZ4Compression supported: 1 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: kBZip2Compression supported: 0 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-13T01:32:14.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.merge_operator: 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_filter: None 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_filter_factory: None 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d719c594e0) 2023-07-13T01:32:14.445 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cache_index_and_filter_blocks: 1 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: pin_top_level_index_and_filter: 1 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: index_type: 0 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: data_block_index_type: 0 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: index_shortening: 1 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: data_block_hash_table_util_ratio: 0.750000 2023-07-13T01:32:14.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: checksum: 4 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: no_block_cache: 0 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_cache: 0x55d718f691f0 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_cache_name: BinnedLRUCache 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_cache_options: 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: capacity : 536870912 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: num_shard_bits : 4 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: strict_capacity_limit : 0 2023-07-13T01:32:14.447 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: high_pri_pool_ratio: 0.000 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_cache_compressed: (nil) 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: persistent_cache: (nil) 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_size: 4096 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_size_deviation: 10 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_restart_interval: 16 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: index_block_restart_interval: 1 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: metadata_block_size: 4096 2023-07-13T01:32:14.448 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: partition_filters: 0 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: use_delta_encoding: 1 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: filter_policy: bloomfilter 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: whole_key_filtering: 1 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: verify_compression: 0 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: read_amp_bytes_per_bit: 0 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: format_version: 5 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: enable_index_compression: 1 2023-07-13T01:32:14.449 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: block_align: 0 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: max_auto_readahead_size: 262144 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: prepopulate_block_cache: 0 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: initial_auto_readahead_size: 8192 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: num_file_reads_for_auto_readahead: 2 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-13T01:32:14.450 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression: NoCompression 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.num_levels: 7 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-13T01:32:14.451 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:32:14.452 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.level: 32767 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-13T01:32:14.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.enabled: false 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-13T01:32:14.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-13T01:32:14.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.arena_block_size: 1048576 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-13T01:32:14.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-13T01:32:14.457 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.table_properties_collectors: 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.inplace_update_support: 0 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-13T01:32:14.458 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.bloom_locality: 0 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.max_successive_merges: 0 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.force_consistency_checks: 1 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.ttl: 2592000 2023-07-13T01:32:14.459 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.enable_blob_files: false 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.min_blob_size: 0 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.blob_file_size: 268435456 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-07-13T01:32:14.460 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.265+0000 7f1bbeb12c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: fbe4c050-9354-4b8f-bb18-0282f0f05e39 2023-07-13T01:32:14.461 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689211934271338, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689211934273049, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 80377, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 250, "table_properties": {"data_size": 78564, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 9896, "raw_average_key_size": 47, "raw_value_size": 72872, "raw_average_value_size": 348, "num_data_blocks": 10, "num_entries": 209, "num_filter_entries": 209, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689211934, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "fbe4c050-9354-4b8f-bb18-0282f0f05e39", "db_session_id": "YRJQHGAAR9W2JCMB5ANA", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689211934273212, "job": 1, "event": "recovery_finished"} 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.269+0000 7f1bbeb12c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.273+0000 7f1bbeb12c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.273+0000 7f1bbeb12c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d71900a000 2023-07-13T01:32:14.462 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.273+0000 7f1bbeb12c80 4 rocksdb: DB pointer 0x55d718ff8000 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.273+0000 7f1bbeb12c80 0 starting mon.a rank 0 at public addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] at bind addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.273+0000 7f1bad323700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.273+0000 7f1bad323700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: ** DB Stats ** 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:32:14.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: ** Compaction Stats [default] ** 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: L0 2/0 80.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:32:14.464 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Sum 2/0 80.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: ** Compaction Stats [default] ** 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-13T01:32:14.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: AddFile(Total Files): cumulative 0, interval 0 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: AddFile(Keys): cumulative 0, interval 0 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Cumulative compaction: 0.00 GB write, 12.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Interval compaction: 0.00 GB write, 12.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:32:14.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Block cache BinnedLRUCache@0x55d718f691f0#7 capacity: 512.00 MB usage: 26.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: Block cache entry stats(count,size,portion): DataBlock(3,25.11 KB,0.00478923%) FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: ** File Read Latency Histogram By Level [default] ** 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 1 mon.a@-1(???) e1 preinit fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 0 mon.a@-1(???).mds e1 new map 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 0 mon.a@-1(???).mds e1 print_map 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: e1 2023-07-13T01:32:14.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: enable_multiple, ever_enabled_multiple: 1,1 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: legacy client fscid: -1 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: No filesystems configured 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:32:14.468 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:32:14.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: debug 2023-07-13T01:32:14.277+0000 7f1bbeb12c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-07-13T01:32:14.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cluster 1689211934.3041003 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2023-07-13T01:32:14.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cluster 1689211934.3042128 mon.a (mon.0) 2 : cluster 0 monmap e1: 1 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0]} removed_ranks: {} 2023-07-13T01:32:14.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cluster 1689211934.305229 mon.a (mon.0) 3 : cluster 0 fsmap 2023-07-13T01:32:14.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cluster 1689211934.3052914 mon.a (mon.0) 4 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2023-07-13T01:32:14.469 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:14 smithi022 bash[26979]: cluster 1689211934.3060591 mon.a (mon.0) 5 : cluster 0 mgrmap e1: no daemons active 2023-07-13T01:32:15.147 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2023-07-13T01:32:15.147 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-07-13T01:32:15.147 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2023-07-13T01:32:15.148 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 9283 ... 2023-07-13T01:32:15.148 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 8765 ... 2023-07-13T01:32:15.375 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a 2023-07-13T01:32:15.375 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a.service: Unit ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a.service not loaded. 2023-07-13T01:32:15.589 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f81712b0-211c-11ee-9b31-001a4aab830c.target.wants/ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a.service -> /etc/systemd/system/ceph-f81712b0-211c-11ee-9b31-001a4aab830c@.service. 2023-07-13T01:32:15.601 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld does not appear to be present 2023-07-13T01:32:15.601 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2023-07-13T01:32:15.602 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld does not appear to be present 2023-07-13T01:32:15.602 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-07-13T01:32:15.602 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2023-07-13T01:32:15.602 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2023-07-13T01:32:15.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:15 smithi022 bash[26979]: audit 1689211934.5402565 mon.a (mon.0) 6 : audit 1 from='client.? 172.21.15.22:0/2828998740' entity='client.admin' 2023-07-13T01:32:17.678 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:17 smithi022 bash[27249]: debug 2023-07-13T01:32:17.373+0000 7ff21f685200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:32:17.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:17 smithi022 bash[26979]: audit 1689211937.4831135 mon.a (mon.0) 7 : audit 0 from='client.? 172.21.15.22:0/2209511823' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-13T01:32:18.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "f81712b0-211c-11ee-9b31-001a4aab830c", 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-13T01:32:18.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:18.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-13T01:32:18.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-13T01:32:18.095 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-13T01:32:18.096 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.097 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-13T01:32:18.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:18.098 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-13T01:32:18.099 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:18.100 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2023-07-13T01:32:07.438542+0000", 2023-07-13T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-13T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:32:18.101 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2023-07-13T01:32:18.678 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:18 smithi022 bash[27249]: debug 2023-07-13T01:32:18.333+0000 7ff21f685200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:32:18.678 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:18 smithi022 bash[27249]: debug 2023-07-13T01:32:18.437+0000 7ff21f685200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:32:18.678 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:18 smithi022 bash[27249]: debug 2023-07-13T01:32:18.541+0000 7ff21f685200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:32:19.178 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:18 smithi022 bash[27249]: debug 2023-07-13T01:32:18.805+0000 7ff21f685200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:32:19.581 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:19 smithi022 bash[27249]: debug 2023-07-13T01:32:19.173+0000 7ff21f685200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:32:19.581 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:19 smithi022 bash[27249]: debug 2023-07-13T01:32:19.345+0000 7ff21f685200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:32:19.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:19 smithi022 bash[27249]: debug 2023-07-13T01:32:19.565+0000 7ff21f685200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:32:20.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:20 smithi022 bash[27249]: debug 2023-07-13T01:32:20.597+0000 7ff21f685200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:32:20.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:20 smithi022 bash[27249]: debug 2023-07-13T01:32:20.713+0000 7ff21f685200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:32:20.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:20 smithi022 bash[27249]: debug 2023-07-13T01:32:20.833+0000 7ff21f685200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:32:21.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:21 smithi022 bash[26979]: audit 1689211941.3785958 mon.a (mon.0) 8 : audit 0 from='client.? 172.21.15.22:0/1847698038' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-13T01:32:21.678 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:21 smithi022 bash[27249]: debug 2023-07-13T01:32:21.325+0000 7ff21f685200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:32:21.678 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:21 smithi022 bash[27249]: debug 2023-07-13T01:32:21.561+0000 7ff21f685200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:32:22.017 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:22.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:32:22.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "f81712b0-211c-11ee-9b31-001a4aab830c", 2023-07-13T01:32:22.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2023-07-13T01:32:22.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-13T01:32:22.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-13T01:32:22.018 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-13T01:32:22.019 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.020 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-13T01:32:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-13T01:32:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-13T01:32:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-13T01:32:22.021 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-13T01:32:22.023 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-13T01:32:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-13T01:32:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-13T01:32:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-13T01:32:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-13T01:32:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-13T01:32:22.025 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-13T01:32:22.026 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:22.027 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2023-07-13T01:32:07.438542+0000", 2023-07-13T01:32:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-13T01:32:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:32:22.028 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (2/15)... 2023-07-13T01:32:22.428 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:21 smithi022 bash[27249]: debug 2023-07-13T01:32:21.953+0000 7ff21f685200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:32:22.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:22 smithi022 bash[27249]: debug 2023-07-13T01:32:22.465+0000 7ff21f685200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:32:23.428 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:23 smithi022 bash[27249]: debug 2023-07-13T01:32:23.037+0000 7ff21f685200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:32:23.428 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:23 smithi022 bash[27249]: debug 2023-07-13T01:32:23.153+0000 7ff21f685200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:32:23.790 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:23 smithi022 bash[27249]: debug 2023-07-13T01:32:23.501+0000 7ff21f685200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:32:23.790 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:23 smithi022 bash[27249]: debug 2023-07-13T01:32:23.625+0000 7ff21f685200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:32:24.056 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:23 smithi022 bash[27249]: debug 2023-07-13T01:32:23.773+0000 7ff21f685200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:32:24.056 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:23 smithi022 bash[27249]: debug 2023-07-13T01:32:23.893+0000 7ff21f685200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:32:24.056 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:24 smithi022 bash[27249]: debug 2023-07-13T01:32:24.021+0000 7ff21f685200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:32:24.354 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:24 smithi022 bash[27249]: debug 2023-07-13T01:32:24.209+0000 7ff21f685200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:32:24.354 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:24 smithi022 bash[27249]: debug 2023-07-13T01:32:24.337+0000 7ff21f685200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:32:25.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:25 smithi022 bash[26979]: audit 1689211945.3770528 mon.a (mon.0) 9 : audit 0 from='client.? 172.21.15.22:0/1073998306' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-13T01:32:25.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:25 smithi022 bash[27249]: debug 2023-07-13T01:32:25.597+0000 7ff21f685200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:32:26.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:26.035 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:32:26.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "f81712b0-211c-11ee-9b31-001a4aab830c", 2023-07-13T01:32:26.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2023-07-13T01:32:26.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-13T01:32:26.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-13T01:32:26.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-13T01:32:26.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:26.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-07-13T01:32:26.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-13T01:32:26.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:26.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-13T01:32:26.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-13T01:32:26.040 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.040 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-13T01:32:26.040 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:26.040 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-13T01:32:26.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-13T01:32:26.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-13T01:32:26.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-13T01:32:26.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-13T01:32:26.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-13T01:32:26.041 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.044 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-13T01:32:26.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-13T01:32:26.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-13T01:32:26.045 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-13T01:32:26.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-13T01:32:26.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-13T01:32:26.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-13T01:32:26.046 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-13T01:32:26.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-13T01:32:26.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.047 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-13T01:32:26.048 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:26.048 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-13T01:32:26.048 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-13T01:32:26.049 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.049 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-13T01:32:26.049 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-13T01:32:26.049 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-13T01:32:26.050 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-13T01:32:26.050 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-13T01:32:26.050 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-13T01:32:26.050 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2023-07-13T01:32:26.051 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:26.051 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:26.051 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.051 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-13T01:32:26.051 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:26.052 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2023-07-13T01:32:07.438542+0000", 2023-07-13T01:32:26.052 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:26.052 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:26.052 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-13T01:32:26.053 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:32:26.053 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (3/15)... 2023-07-13T01:32:26.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: cluster 1689211945.605185 mon.a (mon.0) 10 : cluster 1 Activating manager daemon a 2023-07-13T01:32:26.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: cluster 1689211945.6090908 mon.a (mon.0) 11 : cluster 0 mgrmap e2: a(active, starting, since 0.00414097s) 2023-07-13T01:32:26.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.610857 mon.a (mon.0) 12 : audit 0 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-13T01:32:26.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6110346 mon.a (mon.0) 13 : audit 0 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-13T01:32:26.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6112359 mon.a (mon.0) 14 : audit 0 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-13T01:32:26.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6114676 mon.a (mon.0) 15 : audit 0 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:32:26.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6123018 mon.a (mon.0) 16 : audit 0 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2023-07-13T01:32:26.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: cluster 1689211945.6416004 mon.a (mon.0) 17 : cluster 1 Manager daemon a is now available 2023-07-13T01:32:26.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6588378 mon.a (mon.0) 18 : audit 1 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2023-07-13T01:32:26.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.662961 mon.a (mon.0) 19 : audit 1 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2023-07-13T01:32:26.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6664677 mon.a (mon.0) 20 : audit 1 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' 2023-07-13T01:32:26.930 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6683993 mon.a (mon.0) 21 : audit 1 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' 2023-07-13T01:32:26.930 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:26 smithi022 bash[26979]: audit 1689211945.6701126 mon.a (mon.0) 22 : audit 1 from='mgr.14100 172.21.15.22:0/1033533294' entity='mgr.a' 2023-07-13T01:32:27.927 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:27 smithi022 bash[26979]: cluster 1689211946.6190834 mon.a (mon.0) 23 : cluster 0 mgrmap e3: a(active, since 1.01413s) 2023-07-13T01:32:29.889 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:29 smithi022 bash[26979]: cluster 1689211948.6181803 mon.a (mon.0) 24 : cluster 0 mgrmap e4: a(active, since 3s) 2023-07-13T01:32:30.267 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:30.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:32:30.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "f81712b0-211c-11ee-9b31-001a4aab830c", 2023-07-13T01:32:30.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2023-07-13T01:32:30.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-13T01:32:30.268 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-13T01:32:30.270 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-13T01:32:30.270 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.270 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-13T01:32:30.270 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-13T01:32:30.270 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2023-07-13T01:32:30.270 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:30.271 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-13T01:32:30.272 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-13T01:32:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-13T01:32:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-13T01:32:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-13T01:32:30.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-13T01:32:30.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:30.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2023-07-13T01:32:07.438542+0000", 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:32:30.279 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2023-07-13T01:32:30.927 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:30 smithi022 bash[26979]: audit 1689211949.6832583 mon.a (mon.0) 25 : audit 0 from='client.? 172.21.15.22:0/1506427937' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-13T01:32:32.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:31 smithi022 bash[26979]: audit 1689211951.748683 mon.a (mon.0) 26 : audit 1 from='client.? 172.21.15.22:0/3790808326' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-13T01:32:32.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:31 smithi022 bash[26979]: audit 1689211951.7552054 mon.a (mon.0) 27 : audit 1 from='client.? 172.21.15.22:0/3790808326' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-13T01:32:32.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:32.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2023-07-13T01:32:32.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:32.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-13T01:32:32.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2023-07-13T01:32:32.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2023-07-13T01:32:32.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-13T01:32:32.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-13T01:32:32.394 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2023-07-13T01:32:34.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:34 smithi022 bash[26979]: audit 1689211953.9843252 mon.a (mon.0) 28 : audit 1 from='client.? 172.21.15.22:0/3010044562' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-07-13T01:32:34.427 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:34 smithi022 bash[27249]: ignoring --setuser ceph since I am not root 2023-07-13T01:32:34.428 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:34 smithi022 bash[27249]: ignoring --setgroup ceph since I am not root 2023-07-13T01:32:34.428 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:34 smithi022 bash[27249]: debug 2023-07-13T01:32:34.241+0000 7f703e792200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:32:35.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:35 smithi022 bash[26979]: audit 1689211954.0422528 mon.a (mon.0) 29 : audit 1 from='client.? 172.21.15.22:0/3010044562' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-07-13T01:32:35.368 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:35 smithi022 bash[26979]: cluster 1689211954.0423977 mon.a (mon.0) 30 : cluster 0 mgrmap e5: a(active, since 8s) 2023-07-13T01:32:35.369 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:35 smithi022 bash[27249]: debug 2023-07-13T01:32:35.141+0000 7f703e792200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:32:35.369 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:35 smithi022 bash[27249]: debug 2023-07-13T01:32:35.245+0000 7f703e792200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:32:35.645 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:35 smithi022 bash[27249]: debug 2023-07-13T01:32:35.353+0000 7f703e792200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:32:35.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:35 smithi022 bash[27249]: debug 2023-07-13T01:32:35.629+0000 7f703e792200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:32:36.318 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:36 smithi022 bash[27249]: debug 2023-07-13T01:32:36.021+0000 7f703e792200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:32:36.319 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:36 smithi022 bash[27249]: debug 2023-07-13T01:32:36.189+0000 7f703e792200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:32:36.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:36 smithi022 bash[26979]: audit 1689211956.2557967 mon.a (mon.0) 31 : audit 0 from='client.? 172.21.15.22:0/230589065' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-13T01:32:36.677 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:36 smithi022 bash[27249]: debug 2023-07-13T01:32:36.429+0000 7f703e792200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:32:36.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:32:36.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-07-13T01:32:36.844 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-13T01:32:36.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "a", 2023-07-13T01:32:36.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-13T01:32:36.845 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:32:36.846 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2023-07-13T01:32:36.846 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2023-07-13T01:32:37.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:37 smithi022 bash[27249]: debug 2023-07-13T01:32:37.537+0000 7f703e792200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:32:37.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:37 smithi022 bash[27249]: debug 2023-07-13T01:32:37.653+0000 7f703e792200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:32:37.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:37 smithi022 bash[27249]: debug 2023-07-13T01:32:37.781+0000 7f703e792200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:32:38.677 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:38 smithi022 bash[27249]: debug 2023-07-13T01:32:38.305+0000 7f703e792200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:32:38.677 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:38 smithi022 bash[27249]: debug 2023-07-13T01:32:38.553+0000 7f703e792200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:32:39.427 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:38 smithi022 bash[27249]: debug 2023-07-13T01:32:38.957+0000 7f703e792200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:32:39.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:39 smithi022 bash[27249]: debug 2023-07-13T01:32:39.461+0000 7f703e792200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:32:40.427 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:40 smithi022 bash[27249]: debug 2023-07-13T01:32:40.037+0000 7f703e792200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:32:40.427 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:40 smithi022 bash[27249]: debug 2023-07-13T01:32:40.149+0000 7f703e792200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:32:40.786 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:40 smithi022 bash[27249]: debug 2023-07-13T01:32:40.501+0000 7f703e792200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:32:40.787 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:40 smithi022 bash[27249]: debug 2023-07-13T01:32:40.617+0000 7f703e792200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:32:41.177 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:40 smithi022 bash[27249]: debug 2023-07-13T01:32:40.773+0000 7f703e792200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:32:41.177 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:40 smithi022 bash[27249]: debug 2023-07-13T01:32:40.889+0000 7f703e792200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:32:41.177 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:41 smithi022 bash[27249]: debug 2023-07-13T01:32:41.021+0000 7f703e792200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:32:41.677 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:41 smithi022 bash[27249]: debug 2023-07-13T01:32:41.213+0000 7f703e792200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:32:41.677 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:41 smithi022 bash[27249]: debug 2023-07-13T01:32:41.345+0000 7f703e792200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:32:42.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[27249]: debug 2023-07-13T01:32:42.597+0000 7f703e792200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:32:42.927 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: cluster 1689211962.6256704 mon.a (mon.0) 32 : cluster 1 Active manager daemon a restarted 2023-07-13T01:32:42.927 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: cluster 1689211962.6261399 mon.a (mon.0) 33 : cluster 1 Activating manager daemon a 2023-07-13T01:32:42.927 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: cluster 1689211962.632173 mon.a (mon.0) 34 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2023-07-13T01:32:42.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: cluster 1689211962.6325302 mon.a (mon.0) 35 : cluster 0 mgrmap e6: a(active, starting, since 0.00655269s) 2023-07-13T01:32:42.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: audit 1689211962.6344316 mon.a (mon.0) 36 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:32:42.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: audit 1689211962.6357183 mon.a (mon.0) 37 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2023-07-13T01:32:42.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: audit 1689211962.6366053 mon.a (mon.0) 38 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-13T01:32:42.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: audit 1689211962.636796 mon.a (mon.0) 39 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-13T01:32:42.928 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: audit 1689211962.637011 mon.a (mon.0) 40 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-13T01:32:42.929 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:42 smithi022 bash[26979]: cluster 1689211962.6711934 mon.a (mon.0) 41 : cluster 1 Manager daemon a is now available 2023-07-13T01:32:44.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: cephadm 1689211962.689438 mgr.a (mgr.14120) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2023-07-13T01:32:44.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.693376 mon.a (mon.0) 42 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:44.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.6980066 mon.a (mon.0) 43 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:44.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.7030966 mon.a (mon.0) 44 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:32:44.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.7058835 mon.a (mon.0) 45 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:32:44.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.7136774 mon.a (mon.0) 46 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:32:44.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.7268617 mon.a (mon.0) 47 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2023-07-13T01:32:44.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211962.7322466 mon.a (mon.0) 48 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2023-07-13T01:32:44.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211963.137161 mon.a (mon.0) 49 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:44.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: audit 1689211963.1411734 mon.a (mon.0) 50 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:44.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:43 smithi022 bash[26979]: cluster 1689211963.6375108 mon.a (mon.0) 51 : cluster 0 mgrmap e7: a(active, since 1.01155s) 2023-07-13T01:32:44.366 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:32:44.366 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-07-13T01:32:44.366 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-13T01:32:44.366 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:32:44.367 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2023-07-13T01:32:44.367 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2023-07-13T01:32:45.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:44 smithi022 bash[26979]: audit 1689211963.636579 mgr.a (mgr.14120) 2 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-13T01:32:45.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:44 smithi022 bash[26979]: audit 1689211963.651441 mgr.a (mgr.14120) 3 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-13T01:32:46.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: cluster 1689211965.2933178 mon.a (mon.0) 52 : cluster 0 mgrmap e8: a(active, since 2s) 2023-07-13T01:32:46.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: cephadm 1689211965.4282756 mgr.a (mgr.14120) 4 : cephadm 1 [13/Jul/2023:01:32:45] ENGINE Bus STARTING 2023-07-13T01:32:46.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: cephadm 1689211965.530676 mgr.a (mgr.14120) 5 : cephadm 1 [13/Jul/2023:01:32:45] ENGINE Serving on http://172.21.15.22:8765 2023-07-13T01:32:46.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: cephadm 1689211965.6629884 mgr.a (mgr.14120) 6 : cephadm 1 [13/Jul/2023:01:32:45] ENGINE Serving on https://172.21.15.22:7150 2023-07-13T01:32:46.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: cephadm 1689211965.663456 mgr.a (mgr.14120) 7 : cephadm 1 [13/Jul/2023:01:32:45] ENGINE Bus STARTED 2023-07-13T01:32:46.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: audit 1689211965.6935885 mon.a (mon.0) 53 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:32:46.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: audit 1689211965.8241723 mgr.a (mgr.14120) 8 : audit 0 from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:32:46.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: audit 1689211965.8306313 mon.a (mon.0) 54 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:46.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:46 smithi022 bash[26979]: audit 1689211965.8617718 mon.a (mon.0) 55 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:32:48.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:48 smithi022 bash[26979]: audit 1689211968.0045815 mgr.a (mgr.14120) 9 : audit 0 from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:32:48.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2023-07-13T01:32:48.638 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2023-07-13T01:32:50.926 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: Generating public/private rsa key pair. 2023-07-13T01:32:50.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: Your identification has been saved in /tmp/tmpa4z4jtxa/key. 2023-07-13T01:32:50.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: Your public key has been saved in /tmp/tmpa4z4jtxa/key.pub. 2023-07-13T01:32:50.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: The key fingerprint is: 2023-07-13T01:32:50.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: SHA256:xX2PkTlHdLiI6EwZrWX8r3CHDwWkj6T5Q6ODhp4RX00 ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:50.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: The key's randomart image is: 2023-07-13T01:32:50.927 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: +---[RSA 3072]----+ 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | o .. o+| 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | ..=o. .+.| 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | BEo.o*..| 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | =B.oo.o* | 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | . +S = .+. .| 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | + oo+..+ o | 2023-07-13T01:32:50.928 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | o + o oo = | 2023-07-13T01:32:50.929 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | . + . .. . | 2023-07-13T01:32:50.929 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: | o | 2023-07-13T01:32:50.929 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:32:50 smithi022 bash[27249]: +----[SHA256]-----+ 2023-07-13T01:32:51.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:51 smithi022 bash[26979]: audit 1689211970.1224513 mgr.a (mgr.14120) 10 : audit 0 from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:32:51.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:51 smithi022 bash[26979]: cephadm 1689211970.1226583 mgr.a (mgr.14120) 11 : cephadm 1 Generating ssh key... 2023-07-13T01:32:51.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:51 smithi022 bash[26979]: audit 1689211970.520843 mon.a (mon.0) 56 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:51.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:51 smithi022 bash[26979]: audit 1689211970.524147 mon.a (mon.0) 57 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:53.217 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:32:53.218 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-07-13T01:32:53.218 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2023-07-13T01:32:53.219 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2023-07-13T01:32:53.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:53 smithi022 bash[26979]: audit 1689211972.560944 mgr.a (mgr.14120) 12 : audit 0 from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:32:55.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:55 smithi022 bash[26979]: audit 1689211974.788867 mgr.a (mgr.14120) 13 : audit 0 from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:32:56.357 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:56 smithi022 bash[26979]: cephadm 1689211975.589458 mgr.a (mgr.14120) 14 : cephadm 1 Deploying cephadm binary to smithi022 2023-07-13T01:32:59.248 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2023-07-13T01:32:59.248 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2023-07-13T01:32:59.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:59 smithi022 bash[26979]: audit 1689211978.4178934 mon.a (mon.0) 58 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:32:59.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:59 smithi022 bash[26979]: cephadm 1689211978.4186788 mgr.a (mgr.14120) 15 : cephadm 1 Added host smithi022 2023-07-13T01:32:59.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:32:59 smithi022 bash[26979]: audit 1689211978.4558232 mon.a (mon.0) 59 : audit 0 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:33:02.236 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-07-13T01:33:02.236 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2023-07-13T01:33:02.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:02 smithi022 bash[26979]: audit 1689211981.4643261 mgr.a (mgr.14120) 16 : audit 0 from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:33:02.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:02 smithi022 bash[26979]: cephadm 1689211981.4658206 mgr.a (mgr.14120) 17 : cephadm 1 Saving service mon spec with placement count:5 2023-07-13T01:33:02.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:02 smithi022 bash[26979]: audit 1689211981.4688628 mon.a (mon.0) 60 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:33:02.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:02 smithi022 bash[26979]: audit 1689211981.8867135 mon.a (mon.0) 61 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:33:02.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:02 smithi022 bash[26979]: audit 1689211982.2665696 mon.a (mon.0) 62 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:33:03.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:03 smithi022 bash[26979]: cluster 1689211982.6384068 mgr.a (mgr.14120) 18 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:04.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-07-13T01:33:05.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:04 smithi022 bash[26979]: audit 1689211983.7788732 mgr.a (mgr.14120) 19 : audit 0 from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:33:05.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:04 smithi022 bash[26979]: cephadm 1689211983.7813203 mgr.a (mgr.14120) 20 : cephadm 1 Saving service mgr spec with placement count:2 2023-07-13T01:33:05.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:04 smithi022 bash[26979]: audit 1689211983.785465 mon.a (mon.0) 63 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:33:06.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:05 smithi022 bash[26979]: cluster 1689211984.638782 mgr.a (mgr.14120) 21 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:07.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:06 smithi022 bash[26979]: audit 1689211985.8889642 mon.a (mon.0) 64 : audit 1 from='client.? 172.21.15.22:0/3746627444' entity='client.admin' 2023-07-13T01:33:08.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:07 smithi022 bash[26979]: cluster 1689211986.6391923 mgr.a (mgr.14120) 22 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:08.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:07 smithi022 bash[26979]: audit 1689211987.6032157 mon.a (mon.0) 65 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:33:08.724 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2023-07-13T01:33:09.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:09 smithi022 bash[26979]: audit 1689211988.0093286 mon.a (mon.0) 66 : audit 1 from='client.? 172.21.15.22:0/790764471' entity='client.admin' 2023-07-13T01:33:09.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:09 smithi022 bash[26979]: audit 1689211988.4539444 mon.a (mon.0) 67 : audit 1 from='mgr.14120 172.21.15.22:0/3242447635' entity='mgr.a' 2023-07-13T01:33:10.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:10 smithi022 bash[26979]: cluster 1689211988.6395524 mgr.a (mgr.14120) 23 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:11.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:11 smithi022 bash[26979]: audit 1689211990.372616 mon.a (mon.0) 68 : audit 1 from='client.? 172.21.15.22:0/1474005241' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-07-13T01:33:11.426 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:11 smithi022 bash[27249]: ignoring --setuser ceph since I am not root 2023-07-13T01:33:11.426 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:11 smithi022 bash[27249]: ignoring --setgroup ceph since I am not root 2023-07-13T01:33:11.426 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:11 smithi022 bash[27249]: debug 2023-07-13T01:33:11.236+0000 7f0e4cb6d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:33:12.287 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:12 smithi022 bash[27249]: debug 2023-07-13T01:33:12.164+0000 7f0e4cb6d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:33:12.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:12 smithi022 bash[26979]: audit 1689211991.0183945 mon.a (mon.0) 69 : audit 1 from='client.? 172.21.15.22:0/1474005241' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-07-13T01:33:12.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:12 smithi022 bash[26979]: cluster 1689211991.018493 mon.a (mon.0) 70 : cluster 0 mgrmap e9: a(active, since 28s) 2023-07-13T01:33:12.600 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:12 smithi022 bash[27249]: debug 2023-07-13T01:33:12.272+0000 7f0e4cb6d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:33:12.600 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:12 smithi022 bash[27249]: debug 2023-07-13T01:33:12.380+0000 7f0e4cb6d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:33:13.159 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:12 smithi022 bash[27249]: debug 2023-07-13T01:33:12.664+0000 7f0e4cb6d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:33:13.425 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:13 smithi022 bash[27249]: debug 2023-07-13T01:33:13.144+0000 7f0e4cb6d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:33:13.425 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:13 smithi022 bash[27249]: debug 2023-07-13T01:33:13.320+0000 7f0e4cb6d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:33:13.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:13 smithi022 bash[26979]: audit 1689211993.4041002 mon.a (mon.0) 71 : audit 0 from='client.? 172.21.15.22:0/918378065' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-13T01:33:13.925 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:13 smithi022 bash[27249]: debug 2023-07-13T01:33:13.560+0000 7f0e4cb6d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:33:14.054 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:33:14.055 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-07-13T01:33:14.055 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-13T01:33:14.055 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "a", 2023-07-13T01:33:14.055 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-13T01:33:14.056 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:33:14.056 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2023-07-13T01:33:14.056 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2023-07-13T01:33:15.043 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:14 smithi022 bash[27249]: debug 2023-07-13T01:33:14.664+0000 7f0e4cb6d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:33:15.043 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:14 smithi022 bash[27249]: debug 2023-07-13T01:33:14.780+0000 7f0e4cb6d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:33:15.043 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:14 smithi022 bash[27249]: debug 2023-07-13T01:33:14.908+0000 7f0e4cb6d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:33:15.675 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:15 smithi022 bash[27249]: debug 2023-07-13T01:33:15.396+0000 7f0e4cb6d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:33:15.675 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:15 smithi022 bash[27249]: debug 2023-07-13T01:33:15.628+0000 7f0e4cb6d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:33:16.175 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:16 smithi022 bash[27249]: debug 2023-07-13T01:33:16.020+0000 7f0e4cb6d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:33:16.925 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:16 smithi022 bash[27249]: debug 2023-07-13T01:33:16.520+0000 7f0e4cb6d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:33:17.425 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:17 smithi022 bash[27249]: debug 2023-07-13T01:33:17.096+0000 7f0e4cb6d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:33:17.425 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:17 smithi022 bash[27249]: debug 2023-07-13T01:33:17.208+0000 7f0e4cb6d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:33:17.851 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:17 smithi022 bash[27249]: debug 2023-07-13T01:33:17.564+0000 7f0e4cb6d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:33:17.851 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:17 smithi022 bash[27249]: debug 2023-07-13T01:33:17.688+0000 7f0e4cb6d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:33:18.175 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:17 smithi022 bash[27249]: debug 2023-07-13T01:33:17.836+0000 7f0e4cb6d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:33:18.175 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:17 smithi022 bash[27249]: debug 2023-07-13T01:33:17.960+0000 7f0e4cb6d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:33:18.175 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:18 smithi022 bash[27249]: debug 2023-07-13T01:33:18.088+0000 7f0e4cb6d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:33:18.675 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:18 smithi022 bash[27249]: debug 2023-07-13T01:33:18.284+0000 7f0e4cb6d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:33:18.675 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:18 smithi022 bash[27249]: debug 2023-07-13T01:33:18.416+0000 7f0e4cb6d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:33:20.174 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 01:33:19 smithi022 bash[27249]: debug 2023-07-13T01:33:19.676+0000 7f0e4cb6d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:33:20.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: cluster 1689211999.70113 mon.a (mon.0) 72 : cluster 1 Active manager daemon a restarted 2023-07-13T01:33:20.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: cluster 1689211999.7016053 mon.a (mon.0) 73 : cluster 1 Activating manager daemon a 2023-07-13T01:33:20.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: cluster 1689211999.7079835 mon.a (mon.0) 74 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: cluster 1689211999.7083375 mon.a (mon.0) 75 : cluster 0 mgrmap e10: a(active, starting, since 0.0069012s) 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.7101612 mon.a (mon.0) 76 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.711508 mon.a (mon.0) 77 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.7122204 mon.a (mon.0) 78 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.7124486 mon.a (mon.0) 79 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.7126775 mon.a (mon.0) 80 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-13T01:33:20.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: cluster 1689211999.739298 mon.a (mon.0) 81 : cluster 1 Manager daemon a is now available 2023-07-13T01:33:20.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.770101 mon.a (mon.0) 82 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:33:20.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.7763205 mon.a (mon.0) 83 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:33:20.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.8049855 mon.a (mon.0) 84 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2023-07-13T01:33:20.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:20 smithi022 bash[26979]: audit 1689211999.8090234 mon.a (mon.0) 85 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2023-07-13T01:33:21.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2023-07-13T01:33:21.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-07-13T01:33:21.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-13T01:33:21.510 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2023-07-13T01:33:21.511 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2023-07-13T01:33:21.511 INFO:teuthology.orchestra.run.smithi022.stdout:Generating a dashboard self-signed certificate... 2023-07-13T01:33:21.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: cephadm 1689212000.4461706 mgr.a (mgr.14152) 1 : cephadm 1 [13/Jul/2023:01:33:20] ENGINE Bus STARTING 2023-07-13T01:33:21.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: cephadm 1689212000.5484288 mgr.a (mgr.14152) 2 : cephadm 1 [13/Jul/2023:01:33:20] ENGINE Serving on http://172.21.15.22:8765 2023-07-13T01:33:21.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: cephadm 1689212000.6799142 mgr.a (mgr.14152) 3 : cephadm 1 [13/Jul/2023:01:33:20] ENGINE Serving on https://172.21.15.22:7150 2023-07-13T01:33:21.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: cephadm 1689212000.6802008 mgr.a (mgr.14152) 4 : cephadm 1 [13/Jul/2023:01:33:20] ENGINE Bus STARTED 2023-07-13T01:33:21.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: audit 1689212000.7116923 mgr.a (mgr.14152) 5 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-13T01:33:21.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: cluster 1689212000.7140863 mon.a (mon.0) 86 : cluster 0 mgrmap e11: a(active, since 1.0126s) 2023-07-13T01:33:21.926 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:21 smithi022 bash[26979]: audit 1689212000.7299976 mgr.a (mgr.14152) 6 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-13T01:33:23.841 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-07-13T01:33:23.841 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2023-07-13T01:33:24.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:23 smithi022 bash[26979]: cluster 1689212002.7151175 mon.a (mon.0) 87 : cluster 0 mgrmap e12: a(active, since 3s) 2023-07-13T01:33:24.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:23 smithi022 bash[26979]: audit 1689212002.985339 mgr.a (mgr.14152) 7 : audit 0 from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:33:24.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:23 smithi022 bash[26979]: audit 1689212003.2456427 mon.a (mon.0) 88 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:24.175 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:23 smithi022 bash[26979]: audit 1689212003.2483606 mon.a (mon.0) 89 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:26.253 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$6ANN4XPJmZxtfAcpaO.V3eQp0YQIDyaYW9eSOrp5XRjkfHM2S0M/C", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1689212005, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-07-13T01:33:26.254 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2023-07-13T01:33:26.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:26 smithi022 bash[26979]: audit 1689212005.3503308 mgr.a (mgr.14152) 8 : audit 0 from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:33:26.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:26 smithi022 bash[26979]: audit 1689212005.611537 mon.a (mon.0) 90 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:27.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:27 smithi022 bash[26979]: cluster 1689212006.6181736 mon.a (mon.0) 91 : cluster 0 mgrmap e13: a(active, since 6s) 2023-07-13T01:33:27.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:27 smithi022 bash[26979]: audit 1689212007.0425158 mon.a (mon.0) 92 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:28.346 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2023-07-13T01:33:28.346 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld does not appear to be present 2023-07-13T01:33:28.346 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-07-13T01:33:28.349 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2023-07-13T01:33:28.349 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022.front.sepia.ceph.com:8443/ 2023-07-13T01:33:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2023-07-13T01:33:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: Password: hfb33iciku 2023-07-13T01:33:28.350 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:28.350 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config directory 2023-07-13T01:33:28.351 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling autotune for osd_memory_target 2023-07-13T01:33:28.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:28 smithi022 bash[26979]: audit 1689212007.6556861 mon.a (mon.0) 93 : audit 0 from='client.? 172.21.15.22:0/1295230813' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-07-13T01:33:28.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:28 smithi022 bash[26979]: audit 1689212007.8291206 mon.a (mon.0) 94 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:32.807 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f81712b0-211c-11ee-9b31-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.808 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-07-13T01:33:32.809 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.809 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2023-07-13T01:33:32.809 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.809 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2023-07-13T01:33:32.809 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.810 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2023-07-13T01:33:32.810 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.810 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-07-13T01:33:32.810 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:33:32.810 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2023-07-13T01:33:32.844 INFO:tasks.cephadm:Fetching config... 2023-07-13T01:33:32.845 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:33:32.845 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-07-13T01:33:32.850 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-07-13T01:33:32.850 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:33:32.851 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-07-13T01:33:32.901 INFO:tasks.cephadm:Fetching mon keyring... 2023-07-13T01:33:32.902 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:33:32.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-07-13T01:33:32.958 INFO:tasks.cephadm:Fetching pub ssh key... 2023-07-13T01:33:32.959 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:33:32.959 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-07-13T01:33:33.009 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-07-13T01:33:33.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-13T01:33:33.071 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:33:33.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-13T01:33:33.102 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:33:33.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-13T01:33:33.136 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:33:33.147 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-13T01:33:33.175 INFO:teuthology.orchestra.run.smithi137.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:33:33.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-13T01:33:33.209 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXBNLdGdDTJ+KKfb+5sbfL1oPKdbzYhtOuCnPA0lLOb0FzujYw7KAjWj7D/wsn0qkN5JPWb0Y2z5+XdYGOwXgha7opDoy1GlAxRq2EeYIz4+/4WuZPU6YdjcJFypSgMzROhrZlAU+0ADngfeJDqjVKlNaKIy/nea8TOH1sTxOFPOSWzjkSdPvgWabv4EtQZsdieslQTCiFlfTRtgt5ggRP4cUhjdoHcpedaOBfuNERpfoznM9WT/l/mkwPBOwyp5bzaxbUfDDy2ObGDGef707N2FwFqEEeqGHjvHKWwEuhnWS2qkqPjwKh4opX3QPXl/H/ZK8fLfvXMA1HWcOw1GKIsUnNjki9PAYFfPTNwU1iv9MIaemfBaGWOV5iFpSfsF6zOK/B+rrLabO5f7gUnwF7mHsETwFuSeK32dSHIfXZmwKR05spqD4ACvaylC0k9eOLe/txeq2ZDo3Maou3IaiISWn/pZoO9KaMGfB5R6LgE66TWu57XQqLcYCHKV7F0Bs= ceph-f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:33:33.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-07-13T01:33:33.229 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:33 smithi022 bash[26979]: audit 1689212012.1198835 mon.a (mon.0) 95 : audit 1 from='client.? 172.21.15.22:0/3457355762' entity='client.admin' 2023-07-13T01:33:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:33:39.817 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:39 smithi022 bash[26979]: audit 1689212018.426129 mon.a (mon.0) 96 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:39.817 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:39 smithi022 bash[26979]: audit 1689212018.430391 mon.a (mon.0) 97 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:39.817 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:39 smithi022 bash[26979]: audit 1689212018.4318027 mon.a (mon.0) 98 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:33:39.817 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:39 smithi022 bash[26979]: audit 1689212018.4369144 mon.a (mon.0) 99 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:39.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:39 smithi022 bash[26979]: audit 1689212018.4709737 mon.a (mon.0) 100 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:33:39.818 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:39 smithi022 bash[26979]: audit 1689212018.4790459 mon.a (mon.0) 101 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:40.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:40 smithi022 bash[26979]: cluster 1689212019.7139242 mgr.a (mgr.14152) 9 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:42.613 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-07-13T01:33:42.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-07-13T01:33:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:42 smithi022 bash[26979]: cluster 1689212021.7143366 mgr.a (mgr.14152) 10 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:42 smithi022 bash[26979]: audit 1689212021.9716241 mon.a (mon.0) 102 : audit 1 from='client.? 172.21.15.22:0/276716557' entity='client.admin' 2023-07-13T01:33:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:42 smithi022 bash[26979]: audit 1689212022.0361364 mon.a (mon.0) 103 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:33:43.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:42 smithi022 bash[26979]: audit 1689212022.0441568 mon.a (mon.0) 104 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:45.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:44 smithi022 bash[26979]: cluster 1689212023.7148128 mgr.a (mgr.14152) 11 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:33:47.380 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:46 smithi022 bash[26979]: cluster 1689212025.715269 mgr.a (mgr.14152) 12 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:49.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:48 smithi022 bash[26979]: cluster 1689212027.7158108 mgr.a (mgr.14152) 13 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:50.573 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:50 smithi022 bash[26979]: cluster 1689212029.7162406 mgr.a (mgr.14152) 14 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:51.071 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi084 2023-07-13T01:33:51.072 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:33:51.072 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/etc/ceph/ceph.conf 2023-07-13T01:33:51.080 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:33:51.080 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:33:51.128 INFO:tasks.cephadm:Adding host smithi084 to orchestrator... 2023-07-13T01:33:51.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host add smithi084 2023-07-13T01:33:51.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212030.363575 mgr.a (mgr.14152) 15 : audit 0 from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:33:51.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212030.3687763 mon.a (mon.0) 105 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:51.674 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212030.4146247 mon.a (mon.0) 106 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:33:51.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212030.418606 mon.a (mon.0) 107 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:33:51.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212030.420549 mon.a (mon.0) 108 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:33:51.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: cephadm 1689212030.4227684 mgr.a (mgr.14152) 16 : cephadm 1 Updating smithi022:/etc/ceph/ceph.conf 2023-07-13T01:33:51.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: cephadm 1689212030.5880237 mgr.a (mgr.14152) 17 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:33:51.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: cephadm 1689212030.8039033 mgr.a (mgr.14152) 18 : cephadm 1 Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:33:51.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: cephadm 1689212030.969879 mgr.a (mgr.14152) 19 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:33:51.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212031.1392567 mon.a (mon.0) 109 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:51.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212031.1445498 mon.a (mon.0) 110 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:51.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:51 smithi022 bash[26979]: audit 1689212031.1493068 mon.a (mon.0) 111 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:33:52.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:52 smithi022 bash[26979]: cluster 1689212031.7166183 mgr.a (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:55.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:54 smithi022 bash[26979]: cluster 1689212033.7171292 mgr.a (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:33:57.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:56 smithi022 bash[26979]: cluster 1689212035.7175684 mgr.a (mgr.14152) 22 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:33:59.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:58 smithi022 bash[26979]: cluster 1689212037.717979 mgr.a (mgr.14152) 23 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:00.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:33:59 smithi022 bash[26979]: audit 1689212038.8742268 mgr.a (mgr.14152) 24 : audit 0 from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:34:01.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:00 smithi022 bash[26979]: cephadm 1689212039.672752 mgr.a (mgr.14152) 25 : cephadm 1 Deploying cephadm binary to smithi084 2023-07-13T01:34:01.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:00 smithi022 bash[26979]: cluster 1689212039.7184155 mgr.a (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:02.456 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi084' with addr '172.21.15.84' 2023-07-13T01:34:02.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:02 smithi022 bash[26979]: cluster 1689212041.7188199 mgr.a (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:02.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:02 smithi022 bash[26979]: audit 1689212042.4479697 mon.a (mon.0) 112 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:02.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:02 smithi022 bash[26979]: audit 1689212042.4567156 mon.a (mon.0) 113 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:34:03.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host ls --format=json 2023-07-13T01:34:04.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:03 smithi022 bash[26979]: cephadm 1689212042.4488482 mgr.a (mgr.14152) 28 : cephadm 1 Added host smithi084 2023-07-13T01:34:04.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:03 smithi022 bash[26979]: audit 1689212042.8275595 mon.a (mon.0) 114 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:05.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:04 smithi022 bash[26979]: cluster 1689212043.7193162 mgr.a (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:05.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:04 smithi022 bash[26979]: audit 1689212044.2009377 mon.a (mon.0) 115 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:06.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:06 smithi022 bash[26979]: audit 1689212045.0495915 mon.a (mon.0) 116 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:07.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:07 smithi022 bash[26979]: cluster 1689212045.7197864 mgr.a (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:07.834 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:34:09.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:09 smithi022 bash[26979]: cluster 1689212047.7202055 mgr.a (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:10.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:10 smithi022 bash[26979]: cluster 1689212049.7206097 mgr.a (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:10.926 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:34:10.927 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}] 2023-07-13T01:34:11.583 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi103 2023-07-13T01:34:11.584 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:34:11.584 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.conf 2023-07-13T01:34:11.592 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:34:11.593 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:34:11.639 INFO:tasks.cephadm:Adding host smithi103 to orchestrator... 2023-07-13T01:34:11.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host add smithi103 2023-07-13T01:34:11.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.4851797 mon.a (mon.0) 117 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:11.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.4890645 mon.a (mon.0) 118 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:11.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.493386 mon.a (mon.0) 119 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:11.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.497052 mon.a (mon.0) 120 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:11.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.4982035 mon.a (mon.0) 121 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:34:11.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.4999132 mon.a (mon.0) 122 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:34:11.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.5014389 mon.a (mon.0) 123 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:34:11.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: cephadm 1689212050.503512 mgr.a (mgr.14152) 33 : cephadm 1 Updating smithi084:/etc/ceph/ceph.conf 2023-07-13T01:34:11.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: cephadm 1689212050.6683178 mgr.a (mgr.14152) 34 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:34:11.924 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: cephadm 1689212050.8338234 mgr.a (mgr.14152) 35 : cephadm 1 Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:34:11.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212050.9185648 mgr.a (mgr.14152) 36 : audit 0 from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:34:11.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: cephadm 1689212050.9995441 mgr.a (mgr.14152) 37 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:34:11.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212051.1682954 mon.a (mon.0) 124 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:11.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212051.1715264 mon.a (mon.0) 125 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:11.925 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:11 smithi022 bash[26979]: audit 1689212051.1747448 mon.a (mon.0) 126 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:12.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:12 smithi022 bash[26979]: cluster 1689212051.721035 mgr.a (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:15.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:14 smithi022 bash[26979]: cluster 1689212053.7214673 mgr.a (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:16.338 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:34:17.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:16 smithi022 bash[26979]: cluster 1689212055.721862 mgr.a (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:19.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:18 smithi022 bash[26979]: cluster 1689212057.7223365 mgr.a (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:20.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:20 smithi022 bash[26979]: audit 1689212059.3675714 mgr.a (mgr.14152) 42 : audit 0 from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:34:20.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:20 smithi022 bash[26979]: cluster 1689212059.722802 mgr.a (mgr.14152) 43 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:21.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:21 smithi022 bash[26979]: cephadm 1689212060.2533343 mgr.a (mgr.14152) 44 : cephadm 1 Deploying cephadm binary to smithi103 2023-07-13T01:34:22.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:22 smithi022 bash[26979]: cluster 1689212061.7232518 mgr.a (mgr.14152) 45 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:23.043 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi103' with addr '172.21.15.103' 2023-07-13T01:34:23.744 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host ls --format=json 2023-07-13T01:34:24.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:24 smithi022 bash[26979]: audit 1689212063.0352604 mon.a (mon.0) 127 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:24.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:24 smithi022 bash[26979]: cephadm 1689212063.0360177 mgr.a (mgr.14152) 46 : cephadm 1 Added host smithi103 2023-07-13T01:34:24.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:24 smithi022 bash[26979]: audit 1689212063.0814316 mon.a (mon.0) 128 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:34:24.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:24 smithi022 bash[26979]: audit 1689212063.4553585 mon.a (mon.0) 129 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:25.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:25 smithi022 bash[26979]: cluster 1689212063.7236478 mgr.a (mgr.14152) 47 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:25.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:25 smithi022 bash[26979]: audit 1689212064.8281116 mon.a (mon.0) 130 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:27.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:26 smithi022 bash[26979]: audit 1689212065.6662583 mon.a (mon.0) 131 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:27.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:26 smithi022 bash[26979]: cluster 1689212065.7240484 mgr.a (mgr.14152) 48 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:28.437 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:34:29.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:28 smithi022 bash[26979]: cluster 1689212067.7244985 mgr.a (mgr.14152) 49 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:30.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:30 smithi022 bash[26979]: cluster 1689212069.7249537 mgr.a (mgr.14152) 50 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:31.470 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:34:31.470 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}] 2023-07-13T01:34:32.142 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi137 2023-07-13T01:34:32.143 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:34:32.143 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.conf 2023-07-13T01:34:32.151 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:34:32.151 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:34:32.201 INFO:tasks.cephadm:Adding host smithi137 to orchestrator... 2023-07-13T01:34:32.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host add smithi137 2023-07-13T01:34:32.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.303174 mon.a (mon.0) 132 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:32.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.3069456 mon.a (mon.0) 133 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:32.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.3112662 mon.a (mon.0) 134 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:32.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.3145318 mon.a (mon.0) 135 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.315579 mon.a (mon.0) 136 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.317105 mon.a (mon.0) 137 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.3186367 mon.a (mon.0) 138 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: cephadm 1689212071.3207433 mgr.a (mgr.14152) 51 : cephadm 1 Updating smithi103:/etc/ceph/ceph.conf 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.4629462 mgr.a (mgr.14152) 52 : audit 0 from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: cephadm 1689212071.4851842 mgr.a (mgr.14152) 53 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:34:32.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: cephadm 1689212071.650956 mgr.a (mgr.14152) 54 : cephadm 1 Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:34:32.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: cluster 1689212071.7252553 mgr.a (mgr.14152) 55 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:32.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: cephadm 1689212071.8159826 mgr.a (mgr.14152) 56 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:34:32.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.9871979 mon.a (mon.0) 139 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:32.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.9922438 mon.a (mon.0) 140 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:32.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:32 smithi022 bash[26979]: audit 1689212071.996096 mon.a (mon.0) 141 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:35.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:34 smithi022 bash[26979]: cluster 1689212073.7256634 mgr.a (mgr.14152) 57 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:36.898 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:34:37.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:36 smithi022 bash[26979]: cluster 1689212075.7261558 mgr.a (mgr.14152) 58 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:38.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:38 smithi022 bash[26979]: cluster 1689212077.7266793 mgr.a (mgr.14152) 59 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:40.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:40 smithi022 bash[26979]: cluster 1689212079.727109 mgr.a (mgr.14152) 60 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:40.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:40 smithi022 bash[26979]: audit 1689212079.8023531 mgr.a (mgr.14152) 61 : audit 0 from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi137", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:34:41.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:41 smithi022 bash[26979]: cephadm 1689212080.7104998 mgr.a (mgr.14152) 62 : cephadm 1 Deploying cephadm binary to smithi137 2023-07-13T01:34:42.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:42 smithi022 bash[26979]: cluster 1689212081.7274766 mgr.a (mgr.14152) 63 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:43.536 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi137' with addr '172.21.15.137' 2023-07-13T01:34:44.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host ls --format=json 2023-07-13T01:34:44.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:44 smithi022 bash[26979]: audit 1689212083.5293326 mon.a (mon.0) 142 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:44.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:44 smithi022 bash[26979]: cephadm 1689212083.5301552 mgr.a (mgr.14152) 64 : cephadm 1 Added host smithi137 2023-07-13T01:34:44.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:44 smithi022 bash[26979]: audit 1689212083.571355 mon.a (mon.0) 143 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:34:44.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:44 smithi022 bash[26979]: cluster 1689212083.7279048 mgr.a (mgr.14152) 65 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:44.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:44 smithi022 bash[26979]: audit 1689212083.9476376 mon.a (mon.0) 144 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:46.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:46 smithi022 bash[26979]: audit 1689212085.4014015 mon.a (mon.0) 145 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:46.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:46 smithi022 bash[26979]: cluster 1689212085.728341 mgr.a (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:46.679 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:46 smithi022 bash[26979]: audit 1689212086.297964 mon.a (mon.0) 146 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:34:49.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:48 smithi022 bash[26979]: cluster 1689212087.7287834 mgr.a (mgr.14152) 67 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:50.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:50 smithi022 bash[26979]: cluster 1689212089.7291887 mgr.a (mgr.14152) 68 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:52.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:34:52.005 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}] 2023-07-13T01:34:52.657 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2023-07-13T01:34:52.658 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:34:52.658 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2023-07-13T01:34:52.667 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:34:52.668 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:34:52.714 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2023-07-13T01:34:52.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host add smithi154 2023-07-13T01:34:52.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: cluster 1689212091.7295935 mgr.a (mgr.14152) 69 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:52.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.834877 mon.a (mon.0) 147 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:52.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.8390784 mon.a (mon.0) 148 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.8433743 mon.a (mon.0) 149 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.8464386 mon.a (mon.0) 150 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.8475025 mon.a (mon.0) 151 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.8488336 mon.a (mon.0) 152 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.8499136 mon.a (mon.0) 153 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: cephadm 1689212091.8516269 mgr.a (mgr.14152) 70 : cephadm 1 Updating smithi137:/etc/ceph/ceph.conf 2023-07-13T01:34:52.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212091.9987192 mgr.a (mgr.14152) 71 : audit 0 from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:34:52.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: cephadm 1689212092.0161388 mgr.a (mgr.14152) 72 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:34:52.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212092.515976 mon.a (mon.0) 154 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:52.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212092.520059 mon.a (mon.0) 155 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:52.923 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:52 smithi022 bash[26979]: audit 1689212092.5242305 mon.a (mon.0) 156 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:34:54.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:53 smithi022 bash[26979]: cephadm 1689212092.1806068 mgr.a (mgr.14152) 73 : cephadm 1 Updating smithi137:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:34:54.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:53 smithi022 bash[26979]: cephadm 1689212092.3449879 mgr.a (mgr.14152) 74 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:34:55.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:54 smithi022 bash[26979]: cluster 1689212093.730036 mgr.a (mgr.14152) 75 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:57.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:56 smithi022 bash[26979]: cluster 1689212095.730438 mgr.a (mgr.14152) 76 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:34:57.408 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:34:58.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:34:58 smithi022 bash[26979]: cluster 1689212097.7308319 mgr.a (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:00.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:00 smithi022 bash[26979]: cluster 1689212099.731181 mgr.a (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:01.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:01 smithi022 bash[26979]: audit 1689212100.4347332 mgr.a (mgr.14152) 79 : audit 0 from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:35:02.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:02 smithi022 bash[26979]: cephadm 1689212101.3054657 mgr.a (mgr.14152) 80 : cephadm 1 Deploying cephadm binary to smithi154 2023-07-13T01:35:02.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:02 smithi022 bash[26979]: cluster 1689212101.731549 mgr.a (mgr.14152) 81 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:04.113 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi154' with addr '172.21.15.154' 2023-07-13T01:35:04.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch host ls --format=json 2023-07-13T01:35:05.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:05 smithi022 bash[26979]: cluster 1689212103.7319765 mgr.a (mgr.14152) 82 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:05.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:05 smithi022 bash[26979]: audit 1689212104.1070056 mon.a (mon.0) 157 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:05.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:05 smithi022 bash[26979]: audit 1689212104.1544898 mon.a (mon.0) 158 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:05.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:05 smithi022 bash[26979]: audit 1689212104.5281446 mon.a (mon.0) 159 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:06.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:06 smithi022 bash[26979]: cephadm 1689212104.1076481 mgr.a (mgr.14152) 83 : cephadm 1 Added host smithi154 2023-07-13T01:35:06.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:06 smithi022 bash[26979]: audit 1689212105.9009483 mon.a (mon.0) 160 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:07.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:07 smithi022 bash[26979]: cluster 1689212105.732355 mgr.a (mgr.14152) 84 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:07.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:07 smithi022 bash[26979]: audit 1689212106.7446516 mon.a (mon.0) 161 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:08.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:08 smithi022 bash[26979]: cluster 1689212107.732795 mgr.a (mgr.14152) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:09.539 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:35:10.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:10 smithi022 bash[26979]: cluster 1689212109.733217 mgr.a (mgr.14152) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:12.711 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:35:12.712 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.137", "hostname": "smithi137", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2023-07-13T01:35:13.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: cluster 1689212111.7337086 mgr.a (mgr.14152) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:13.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.180513 mon.a (mon.0) 162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:13.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.1852217 mon.a (mon.0) 163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:13.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.188719 mon.a (mon.0) 164 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:13.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.1917007 mon.a (mon.0) 165 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:13.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.1927395 mon.a (mon.0) 166 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:35:13.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.1943197 mon.a (mon.0) 167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:13.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:12 smithi022 bash[26979]: audit 1689212112.195549 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:13.390 INFO:tasks.cephadm:Setting crush tunables to default 2023-07-13T01:35:13.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd crush tunables default 2023-07-13T01:35:14.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: cephadm 1689212112.1975799 mgr.a (mgr.14152) 88 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: cephadm 1689212112.3621156 mgr.a (mgr.14152) 89 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: cephadm 1689212112.5273015 mgr.a (mgr.14152) 90 : cephadm 1 Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: cephadm 1689212112.6916304 mgr.a (mgr.14152) 91 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: audit 1689212112.7058098 mgr.a (mgr.14152) 92 : audit 0 from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: audit 1689212112.8605762 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: audit 1689212112.8637283 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:14.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:13 smithi022 bash[26979]: audit 1689212112.8678522 mon.a (mon.0) 171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:15.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:14 smithi022 bash[26979]: cluster 1689212113.7341988 mgr.a (mgr.14152) 93 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:17.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:16 smithi022 bash[26979]: cluster 1689212115.734626 mgr.a (mgr.14152) 94 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:18.084 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:35:19.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:18 smithi022 bash[26979]: cluster 1689212117.735026 mgr.a (mgr.14152) 95 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:20.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:20 smithi022 bash[26979]: cluster 1689212119.7353377 mgr.a (mgr.14152) 96 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:21.349 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2023-07-13T01:35:21.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:21 smithi022 bash[26979]: audit 1689212121.0212185 mon.a (mon.0) 172 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-13T01:35:22.020 INFO:tasks.cephadm:Adding mon.a on smithi022 2023-07-13T01:35:22.021 INFO:tasks.cephadm:Adding mon.b on smithi084 2023-07-13T01:35:22.021 INFO:tasks.cephadm:Adding mon.c on smithi103 2023-07-13T01:35:22.021 INFO:tasks.cephadm:Adding mon.d on smithi137 2023-07-13T01:35:22.021 INFO:tasks.cephadm:Adding mon.e on smithi154 2023-07-13T01:35:22.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch apply mon '5;smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e' 2023-07-13T01:35:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:22 smithi022 bash[26979]: audit 1689212121.3399532 mon.a (mon.0) 173 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-13T01:35:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:22 smithi022 bash[26979]: cluster 1689212121.3400156 mon.a (mon.0) 174 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:22 smithi022 bash[26979]: cluster 1689212121.735698 mgr.a (mgr.14152) 97 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:23.219 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:25.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:24 smithi022 bash[26979]: cluster 1689212123.7360883 mgr.a (mgr.14152) 98 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:26.127 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2023-07-13T01:35:26.780 DEBUG:teuthology.orchestra.run.smithi084:mon.b> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.b.service 2023-07-13T01:35:26.783 DEBUG:teuthology.orchestra.run.smithi103:mon.c> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.c.service 2023-07-13T01:35:26.786 DEBUG:teuthology.orchestra.run.smithi137:mon.d> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.d.service 2023-07-13T01:35:26.790 DEBUG:teuthology.orchestra.run.smithi154:mon.e> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.e.service 2023-07-13T01:35:26.792 INFO:tasks.cephadm:Waiting for 5 mons in monmap... 2023-07-13T01:35:26.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph mon dump -f json 2023-07-13T01:35:26.991 INFO:journalctl@ceph.mon.c.smithi103.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:35:27.043 INFO:journalctl@ceph.mon.b.smithi084.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:35:27.057 INFO:journalctl@ceph.mon.e.smithi154.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:35:27.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:35:27.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: cluster 1689212125.7364872 mgr.a (mgr.14152) 99 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:27.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.1217864 mon.a (mon.0) 175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:27.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.1288266 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:27.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.7079802 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:27.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.7095037 mon.a (mon.0) 178 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:27.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.7169654 mon.a (mon.0) 179 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:27.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.7195785 mon.a (mon.0) 180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:27.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:26 smithi022 bash[26979]: audit 1689212126.7206607 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:28.013 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:28.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:27 smithi022 bash[26979]: audit 1689212126.110752 mgr.a (mgr.14152) 100 : audit 0 from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "5;smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:35:28.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:27 smithi022 bash[26979]: cephadm 1689212126.1172419 mgr.a (mgr.14152) 101 : cephadm 1 Saving service mon spec with placement smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e;count:5 2023-07-13T01:35:28.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:27 smithi022 bash[26979]: cephadm 1689212126.7219415 mgr.a (mgr.14152) 102 : cephadm 1 Deploying daemon mon.e on smithi154 2023-07-13T01:35:29.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:28 smithi022 bash[26979]: cluster 1689212127.7369199 mgr.a (mgr.14152) 103 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:30.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:30 smithi022 bash[26979]: cluster 1689212129.7373247 mgr.a (mgr.14152) 104 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:32.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-13T01:35:32.538 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"f81712b0-211c-11ee-9b31-001a4aab830c","modified":"2023-07-13T01:32:02.659334Z","created":"2023-07-13T01:32:02.659334Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-07-13T01:35:32.541 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2023-07-13T01:35:32.993 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:32 smithi154 systemd[1]: Started Ceph mon.e for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:35:33.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:32 smithi022 bash[26979]: cluster 1689212131.7376676 mgr.a (mgr.14152) 105 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:33.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:32 smithi022 bash[26979]: audit 1689212132.5329711 mon.a (mon.0) 182 : audit 0 from='client.? 172.21.15.154:0/258816646' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:35:34.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.080+0000 7f834ae64c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-13T01:35:34.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.080+0000 7f834ae64c80 0 ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev), process ceph-mon, pid 7 2023-07-13T01:35:34.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.080+0000 7f834ae64c80 0 pidfile_write: ignore empty --pid-file 2023-07-13T01:35:34.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 0 load: jerasure load: lrc 2023-07-13T01:35:34.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: RocksDB version: 7.9.2 2023-07-13T01:35:34.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Git sha 0 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Compile date 2023-07-12 14:33:48 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: DB SUMMARY 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: DB Session ID: MHR97XGKMF1281QWY77N 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: CURRENT file: CURRENT 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: IDENTITY file: IDENTITY 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-e/store.db dir, Total Num: 0, files: 2023-07-13T01:35:34.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-e/store.db: 000004.log size: 511 ; 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.error_if_exists: 0 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.create_if_missing: 0 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.paranoid_checks: 1 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.env: 0x560bc4c6d720 2023-07-13T01:35:34.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.fs: PosixFileSystem 2023-07-13T01:35:34.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.info_log: 0x560bc818d3c0 2023-07-13T01:35:34.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-13T01:35:34.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.statistics: (nil) 2023-07-13T01:35:34.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.use_fsync: 0 2023-07-13T01:35:34.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_log_file_size: 0 2023-07-13T01:35:34.277 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-13T01:35:34.277 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-13T01:35:34.277 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.allow_fallocate: 1 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.use_direct_reads: 0 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-13T01:35:34.278 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.create_missing_column_families: 0 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.db_log_dir: 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.wal_dir: 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-13T01:35:34.279 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.advise_random_on_open: 1 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.write_buffer_manager: 0x560bc741c5a0 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-13T01:35:34.280 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.rate_limiter: (nil) 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.unordered_write: 0 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-13T01:35:34.281 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.row_cache: None 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.wal_filter: None 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.two_write_queues: 0 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.manual_wal_flush: 0 2023-07-13T01:35:34.282 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.wal_compression: 0 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.atomic_flush: 0 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.log_readahead_size: 0 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-13T01:35:34.283 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_background_jobs: 2 2023-07-13T01:35:34.284 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_background_compactions: -1 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_subcompactions: 1 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_total_wal_size: 0 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-13T01:35:34.285 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_open_files: -1 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bytes_per_sync: 0 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_background_flushes: -1 2023-07-13T01:35:34.286 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Compression algorithms supported: 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kZSTD supported: 0 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kXpressCompression supported: 0 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kZlibCompression supported: 1 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kSnappyCompression supported: 1 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kLZ4Compression supported: 1 2023-07-13T01:35:34.287 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: kBZip2Compression supported: 0 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-e/store.db/MANIFEST-000005 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.merge_operator: 2023-07-13T01:35:34.288 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_filter: None 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_filter_factory: None 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560bc818d4e0) 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cache_index_and_filter_blocks: 1 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-13T01:35:34.289 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: pin_top_level_index_and_filter: 1 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: index_type: 0 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: data_block_index_type: 0 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: index_shortening: 1 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: data_block_hash_table_util_ratio: 0.750000 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: checksum: 4 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: no_block_cache: 0 2023-07-13T01:35:34.290 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_cache: 0x560bc749d1f0 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_cache_name: BinnedLRUCache 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_cache_options: 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: capacity : 536870912 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: num_shard_bits : 4 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: strict_capacity_limit : 0 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: high_pri_pool_ratio: 0.000 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_cache_compressed: (nil) 2023-07-13T01:35:34.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: persistent_cache: (nil) 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_size: 4096 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_size_deviation: 10 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_restart_interval: 16 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: index_block_restart_interval: 1 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: metadata_block_size: 4096 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: partition_filters: 0 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: use_delta_encoding: 1 2023-07-13T01:35:34.292 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: filter_policy: bloomfilter 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: whole_key_filtering: 1 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: verify_compression: 0 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: read_amp_bytes_per_bit: 0 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: format_version: 5 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: enable_index_compression: 1 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: block_align: 0 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: max_auto_readahead_size: 262144 2023-07-13T01:35:34.293 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: prepopulate_block_cache: 0 2023-07-13T01:35:34.294 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: initial_auto_readahead_size: 8192 2023-07-13T01:35:34.294 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: num_file_reads_for_auto_readahead: 2 2023-07-13T01:35:34.294 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-13T01:35:34.294 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-13T01:35:34.294 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression: NoCompression 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.num_levels: 7 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-13T01:35:34.295 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-13T01:35:34.296 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.level: 32767 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:34.297 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.enabled: false 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-13T01:35:34.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-13T01:35:34.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.arena_block_size: 1048576 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-13T01:35:34.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-13T01:35:34.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.table_properties_collectors: 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.inplace_update_support: 0 2023-07-13T01:35:34.302 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.bloom_locality: 0 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.max_successive_merges: 0 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-13T01:35:34.303 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.force_consistency_checks: 1 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.ttl: 2592000 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.enable_blob_files: false 2023-07-13T01:35:34.304 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.min_blob_size: 0 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.blob_file_size: 268435456 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-07-13T01:35:34.305 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-e/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5b2ff739-3e3e-44d5-95cf-4bf4f3c64892 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212134095539, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212134096091, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689212134, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5b2ff739-3e3e-44d5-95cf-4bf4f3c64892", "db_session_id": "MHR97XGKMF1281QWY77N", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-13T01:35:34.306 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212134096213, "job": 1, "event": "recovery_finished"} 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.088+0000 7f834ae64c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-e/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560bc753e000 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 4 rocksdb: DB pointer 0x560bc752c000 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 0 mon.e does not exist in monmap, will attempt to join an existing cluster 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 0 using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f8339675700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-13T01:35:34.307 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f8339675700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: ** DB Stats ** 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-13T01:35:34.308 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: ** Compaction Stats [default] ** 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:34.309 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: ** Compaction Stats [default] ** 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:34.310 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: AddFile(Total Files): cumulative 0, interval 0 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: AddFile(Keys): cumulative 0, interval 0 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Cumulative compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Interval compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Block cache BinnedLRUCache@0x560bc749d1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.8e-05 secs_since: 0 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-13T01:35:34.311 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: ** File Read Latency Histogram By Level [default] ** 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 0 starting mon.e rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-e fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.092+0000 7f834ae64c80 1 mon.e@-1(???) e0 preinit fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 0 mon.e@-1(synchronizing).mds e1 new map 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 0 mon.e@-1(synchronizing).mds e1 print_map 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: e1 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: enable_multiple, ever_enabled_multiple: 1,1 2023-07-13T01:35:34.312 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: legacy client fscid: -1 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: No filesystems configured 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-13T01:35:34.313 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 0 mon.e@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 0 mon.e@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 0 mon.e@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 0 mon.e@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212107.732795 mgr.a (mgr.14152) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.314 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212109.733217 mgr.a (mgr.14152) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212111.7337086 mgr.a (mgr.14152) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.180513 mon.a (mon.0) 162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.1852217 mon.a (mon.0) 163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.188719 mon.a (mon.0) 164 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.1917007 mon.a (mon.0) 165 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.1927395 mon.a (mon.0) 166 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:35:34.315 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.1943197 mon.a (mon.0) 167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.195549 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212112.1975799 mgr.a (mgr.14152) 88 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212112.3621156 mgr.a (mgr.14152) 89 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212112.5273015 mgr.a (mgr.14152) 90 : cephadm 1 Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212112.6916304 mgr.a (mgr.14152) 91 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.7058098 mgr.a (mgr.14152) 92 : audit 0 from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.8605762 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.316 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.8637283 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212112.8678522 mon.a (mon.0) 171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212113.7341988 mgr.a (mgr.14152) 93 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212115.734626 mgr.a (mgr.14152) 94 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212117.735026 mgr.a (mgr.14152) 95 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212119.7353377 mgr.a (mgr.14152) 96 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212121.0212185 mon.a (mon.0) 172 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-13T01:35:34.317 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212121.3399532 mon.a (mon.0) 173 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212121.3400156 mon.a (mon.0) 174 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212121.735698 mgr.a (mgr.14152) 97 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212123.7360883 mgr.a (mgr.14152) 98 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212125.7364872 mgr.a (mgr.14152) 99 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.1217864 mon.a (mon.0) 175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.1288266 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.7079802 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:34.318 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.7095037 mon.a (mon.0) 178 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:34.319 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.7169654 mon.a (mon.0) 179 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.319 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.7195785 mon.a (mon.0) 180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:34.319 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.7206607 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:34.319 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212126.110752 mgr.a (mgr.14152) 100 : audit 0 from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "5;smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:35:34.319 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212126.1172419 mgr.a (mgr.14152) 101 : cephadm 1 Saving service mon spec with placement smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e;count:5 2023-07-13T01:35:34.319 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212126.7219415 mgr.a (mgr.14152) 102 : cephadm 1 Deploying daemon mon.e on smithi154 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212127.7369199 mgr.a (mgr.14152) 103 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212129.7373247 mgr.a (mgr.14152) 104 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cluster 1689212131.7376676 mgr.a (mgr.14152) 105 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212132.5329711 mon.a (mon.0) 182 : audit 0 from='client.? 172.21.15.154:0/258816646' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212132.9487147 mon.a (mon.0) 183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212132.9538925 mon.a (mon.0) 184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.320 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212132.9595072 mon.a (mon.0) 185 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212132.9605947 mon.a (mon.0) 186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: audit 1689212132.9621654 mon.a (mon.0) 187 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: cephadm 1689212132.9639223 mgr.a (mgr.14152) 106 : cephadm 1 Deploying daemon mon.c on smithi103 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.124+0000 7f833c67b700 1 mon.e@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expand map: {default=false} 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta from 'false' to 'false' 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expanded map: {default=false} 2023-07-13T01:35:34.321 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expand map: {default=info} 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta from 'info' to 'info' 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expanded map: {default=info} 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expand map: {default=daemon} 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expanded map: {default=daemon} 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expand map: {default=debug} 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta from 'debug' to 'debug' 2023-07-13T01:35:34.322 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 20 expand_channel_meta expanded map: {default=debug} 2023-07-13T01:35:34.323 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:34 smithi154 bash[27744]: debug 2023-07-13T01:35:34.128+0000 7f833c67b700 10 mon.e@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-07-13T01:35:34.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:33 smithi022 bash[26979]: audit 1689212132.9487147 mon.a (mon.0) 183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:33 smithi022 bash[26979]: audit 1689212132.9538925 mon.a (mon.0) 184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:33 smithi022 bash[26979]: audit 1689212132.9595072 mon.a (mon.0) 185 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:34.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:33 smithi022 bash[26979]: audit 1689212132.9605947 mon.a (mon.0) 186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:34.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:33 smithi022 bash[26979]: audit 1689212132.9621654 mon.a (mon.0) 187 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:34.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:33 smithi022 bash[26979]: cephadm 1689212132.9639223 mgr.a (mgr.14152) 106 : cephadm 1 Deploying daemon mon.c on smithi103 2023-07-13T01:35:34.440 INFO:tasks.cephadm:Waiting for 5 mons in monmap... 2023-07-13T01:35:34.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph mon dump -f json 2023-07-13T01:35:37.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:37 smithi103 systemd[1]: Started Ceph mon.c for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:35:38.136 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:35:39.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.938+0000 7f9c01028c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-13T01:35:39.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.938+0000 7f9c01028c80 0 ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev), process ceph-mon, pid 7 2023-07-13T01:35:39.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.938+0000 7f9c01028c80 0 pidfile_write: ignore empty --pid-file 2023-07-13T01:35:39.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 0 load: jerasure load: lrc 2023-07-13T01:35:39.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: RocksDB version: 7.9.2 2023-07-13T01:35:39.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Git sha 0 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Compile date 2023-07-12 14:33:48 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: DB SUMMARY 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: DB Session ID: L0DJ8XAUUDTKMM1CNVMX 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: CURRENT file: CURRENT 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: IDENTITY file: IDENTITY 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-13T01:35:39.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-07-13T01:35:39.120 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-07-13T01:35:39.120 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.error_if_exists: 0 2023-07-13T01:35:39.120 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.create_if_missing: 0 2023-07-13T01:35:39.120 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.paranoid_checks: 1 2023-07-13T01:35:39.120 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-07-13T01:35:39.121 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-13T01:35:39.121 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-13T01:35:39.121 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.env: 0x562feecc7720 2023-07-13T01:35:39.121 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.fs: PosixFileSystem 2023-07-13T01:35:39.121 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.info_log: 0x562ff1e193c0 2023-07-13T01:35:39.121 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.statistics: (nil) 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.use_fsync: 0 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_log_file_size: 0 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-13T01:35:39.122 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.allow_fallocate: 1 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.use_direct_reads: 0 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.create_missing_column_families: 0 2023-07-13T01:35:39.123 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.db_log_dir: 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.wal_dir: 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-13T01:35:39.124 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.advise_random_on_open: 1 2023-07-13T01:35:39.125 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-13T01:35:39.125 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.write_buffer_manager: 0x562ff10a85a0 2023-07-13T01:35:39.125 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-13T01:35:39.126 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-13T01:35:39.126 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-13T01:35:39.126 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.rate_limiter: (nil) 2023-07-13T01:35:39.127 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-13T01:35:39.127 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-13T01:35:39.128 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.unordered_write: 0 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-13T01:35:39.129 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.row_cache: None 2023-07-13T01:35:39.130 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.wal_filter: None 2023-07-13T01:35:39.130 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-13T01:35:39.130 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-13T01:35:39.130 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.two_write_queues: 0 2023-07-13T01:35:39.130 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.manual_wal_flush: 0 2023-07-13T01:35:39.130 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.wal_compression: 0 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.atomic_flush: 0 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.log_readahead_size: 0 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-13T01:35:39.131 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-07-13T01:35:39.132 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-13T01:35:39.132 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-13T01:35:39.132 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-07-13T01:35:39.132 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_background_jobs: 2 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_background_compactions: -1 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_subcompactions: 1 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-13T01:35:39.133 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-13T01:35:39.134 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_total_wal_size: 0 2023-07-13T01:35:39.134 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-13T01:35:39.134 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-13T01:35:39.134 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-13T01:35:39.134 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-13T01:35:39.134 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_open_files: -1 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bytes_per_sync: 0 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_background_flushes: -1 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Compression algorithms supported: 2023-07-13T01:35:39.135 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kZSTD supported: 0 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kXpressCompression supported: 0 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kZlibCompression supported: 1 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kSnappyCompression supported: 1 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kLZ4Compression supported: 1 2023-07-13T01:35:39.136 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: kBZip2Compression supported: 0 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.merge_operator: 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_filter: None 2023-07-13T01:35:39.137 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_filter_factory: None 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562ff1e194e0) 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cache_index_and_filter_blocks: 1 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-13T01:35:39.138 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-13T01:35:39.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: pin_top_level_index_and_filter: 1 2023-07-13T01:35:39.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: index_type: 0 2023-07-13T01:35:39.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: data_block_index_type: 0 2023-07-13T01:35:39.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: index_shortening: 1 2023-07-13T01:35:39.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: data_block_hash_table_util_ratio: 0.750000 2023-07-13T01:35:39.139 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: checksum: 4 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: no_block_cache: 0 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_cache: 0x562ff11291f0 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_cache_name: BinnedLRUCache 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_cache_options: 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: capacity : 536870912 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: num_shard_bits : 4 2023-07-13T01:35:39.140 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: strict_capacity_limit : 0 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: high_pri_pool_ratio: 0.000 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_cache_compressed: (nil) 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: persistent_cache: (nil) 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_size: 4096 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_size_deviation: 10 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_restart_interval: 16 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: index_block_restart_interval: 1 2023-07-13T01:35:39.141 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: metadata_block_size: 4096 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: partition_filters: 0 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: use_delta_encoding: 1 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: filter_policy: bloomfilter 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: whole_key_filtering: 1 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: verify_compression: 0 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: read_amp_bytes_per_bit: 0 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: format_version: 5 2023-07-13T01:35:39.142 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: enable_index_compression: 1 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: block_align: 0 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: max_auto_readahead_size: 262144 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: prepopulate_block_cache: 0 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: initial_auto_readahead_size: 8192 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: num_file_reads_for_auto_readahead: 2 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-13T01:35:39.143 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression: NoCompression 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.num_levels: 7 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-13T01:35:39.144 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-13T01:35:39.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-13T01:35:39.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-13T01:35:39.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-13T01:35:39.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-13T01:35:39.145 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-13T01:35:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-13T01:35:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-13T01:35:39.146 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.level: 32767 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.enabled: false 2023-07-13T01:35:39.147 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:39.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-13T01:35:39.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-13T01:35:39.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-13T01:35:39.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-13T01:35:39.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-13T01:35:39.148 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-13T01:35:39.149 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.arena_block_size: 1048576 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-13T01:35:39.150 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-13T01:35:39.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-13T01:35:39.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-13T01:35:39.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-13T01:35:39.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-13T01:35:39.151 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-13T01:35:39.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-13T01:35:39.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-13T01:35:39.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-13T01:35:39.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-13T01:35:39.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-13T01:35:39.152 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.table_properties_collectors: 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.inplace_update_support: 0 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.bloom_locality: 0 2023-07-13T01:35:39.153 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.max_successive_merges: 0 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.force_consistency_checks: 1 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.ttl: 2592000 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-13T01:35:39.154 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.enable_blob_files: false 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.min_blob_size: 0 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.blob_file_size: 268435456 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-13T01:35:39.155 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-13T01:35:39.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-13T01:35:39.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-07-13T01:35:39.156 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-13T01:35:39.157 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.946+0000 7f9c01028c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-13T01:35:39.157 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-13T01:35:39.157 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92f2c99e-06e7-44ea-9372-5097160eb032 2023-07-13T01:35:39.157 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212138951490, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-13T01:35:39.158 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-13T01:35:39.158 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212138952528, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689212138, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92f2c99e-06e7-44ea-9372-5097160eb032", "db_session_id": "L0DJ8XAUUDTKMM1CNVMX", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-13T01:35:39.158 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212138952693, "job": 1, "event": "recovery_finished"} 2023-07-13T01:35:39.158 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.950+0000 7f9c01028c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-13T01:35:39.158 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-13T01:35:39.158 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562ff11ca000 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 4 rocksdb: DB pointer 0x562ff11b8000 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9bef839700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9bef839700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: ** DB Stats ** 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:39.159 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: ** Compaction Stats [default] ** 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-13T01:35:39.160 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: ** Compaction Stats [default] ** 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-13T01:35:39.161 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: AddFile(Total Files): cumulative 0, interval 0 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: AddFile(Keys): cumulative 0, interval 0 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:39.162 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Block cache BinnedLRUCache@0x562ff11291f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: ** File Read Latency Histogram By Level [default] ** 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 0 using public_addr v2:172.21.15.103:0/0 -> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 0 starting mon.c rank -1 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:39.163 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.954+0000 7f9c01028c80 1 mon.c@-1(???) e0 preinit fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 0 mon.c@-1(synchronizing).mds e1 new map 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 0 mon.c@-1(synchronizing).mds e1 print_map 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: e1 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: enable_multiple, ever_enabled_multiple: 1,1 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: legacy client fscid: -1 2023-07-13T01:35:39.164 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: No filesystems configured 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-13T01:35:39.165 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-13T01:35:39.166 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:39.166 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:39.166 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.978+0000 7f9bf283f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:39.166 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212107.732795 mgr.a (mgr.14152) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.166 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212109.733217 mgr.a (mgr.14152) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.166 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212111.7337086 mgr.a (mgr.14152) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.180513 mon.a (mon.0) 162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.1852217 mon.a (mon.0) 163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.188719 mon.a (mon.0) 164 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.1917007 mon.a (mon.0) 165 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.1927395 mon.a (mon.0) 166 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.1943197 mon.a (mon.0) 167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.195549 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:39.167 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212112.1975799 mgr.a (mgr.14152) 88 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212112.3621156 mgr.a (mgr.14152) 89 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212112.5273015 mgr.a (mgr.14152) 90 : cephadm 1 Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212112.6916304 mgr.a (mgr.14152) 91 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.7058098 mgr.a (mgr.14152) 92 : audit 0 from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.8605762 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.8637283 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.168 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212112.8678522 mon.a (mon.0) 171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212113.7341988 mgr.a (mgr.14152) 93 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212115.734626 mgr.a (mgr.14152) 94 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212117.735026 mgr.a (mgr.14152) 95 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212119.7353377 mgr.a (mgr.14152) 96 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212121.0212185 mon.a (mon.0) 172 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212121.3399532 mon.a (mon.0) 173 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212121.3400156 mon.a (mon.0) 174 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:39.169 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212121.735698 mgr.a (mgr.14152) 97 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212123.7360883 mgr.a (mgr.14152) 98 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212125.7364872 mgr.a (mgr.14152) 99 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.1217864 mon.a (mon.0) 175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.1288266 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.7079802 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.7095037 mon.a (mon.0) 178 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.7169654 mon.a (mon.0) 179 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.170 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.7195785 mon.a (mon.0) 180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.7206607 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212126.110752 mgr.a (mgr.14152) 100 : audit 0 from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "5;smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212126.1172419 mgr.a (mgr.14152) 101 : cephadm 1 Saving service mon spec with placement smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e;count:5 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212126.7219415 mgr.a (mgr.14152) 102 : cephadm 1 Deploying daemon mon.e on smithi154 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212127.7369199 mgr.a (mgr.14152) 103 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212129.7373247 mgr.a (mgr.14152) 104 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.171 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cluster 1689212131.7376676 mgr.a (mgr.14152) 105 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212132.5329711 mon.a (mon.0) 182 : audit 0 from='client.? 172.21.15.154:0/258816646' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212132.9487147 mon.a (mon.0) 183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212132.9538925 mon.a (mon.0) 184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212132.9595072 mon.a (mon.0) 185 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212132.9605947 mon.a (mon.0) 186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: audit 1689212132.9621654 mon.a (mon.0) 187 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: cephadm 1689212132.9639223 mgr.a (mgr.14152) 106 : cephadm 1 Deploying daemon mon.c on smithi103 2023-07-13T01:35:39.172 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expand map: {default=false} 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta from 'false' to 'false' 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expanded map: {default=false} 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expand map: {default=info} 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta from 'info' to 'info' 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expanded map: {default=info} 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expand map: {default=daemon} 2023-07-13T01:35:39.173 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-07-13T01:35:39.174 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expanded map: {default=daemon} 2023-07-13T01:35:39.174 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expand map: {default=debug} 2023-07-13T01:35:39.174 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta from 'debug' to 'debug' 2023-07-13T01:35:39.174 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 20 expand_channel_meta expanded map: {default=debug} 2023-07-13T01:35:39.174 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:38 smithi103 bash[27315]: debug 2023-07-13T01:35:38.982+0000 7f9bf283f700 10 mon.c@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-07-13T01:35:39.402 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212134.1444824 mon.a (mon.0) 189 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:39.402 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212134.144811 mon.a (mon.0) 190 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:39.402 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212134.1681206 mon.a (mon.0) 191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.402 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212135.13855 mon.a (mon.0) 192 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.402 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212135.7385013 mgr.a (mgr.14152) 108 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212136.1384728 mon.a (mon.0) 193 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212136.1432571 mon.e (mon.1) 1 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212137.1386065 mon.a (mon.0) 194 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212137.7389271 mgr.a (mgr.14152) 109 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212138.1387663 mon.a (mon.0) 195 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212138.989348 mon.a (mon.0) 196 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212139.1392963 mon.a (mon.0) 197 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.403 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212139.1891005 mon.a (mon.0) 198 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212139.199562 mon.a (mon.0) 199 : cluster 0 monmap e2: 2 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212139.2197783 mon.a (mon.0) 200 : cluster 0 fsmap 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212139.219835 mon.a (mon.0) 201 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212139.220121 mon.a (mon.0) 202 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: cluster 1689212139.2268438 mon.a (mon.0) 203 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212139.2313154 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.404 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212139.2359023 mon.a (mon.0) 205 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.405 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212139.2508278 mon.a (mon.0) 206 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.405 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212139.2521687 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:39.405 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:39 smithi154 bash[27744]: audit 1689212139.25384 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:39.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212134.1444824 mon.a (mon.0) 189 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:39.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212134.144811 mon.a (mon.0) 190 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:39.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212134.1681206 mon.a (mon.0) 191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212135.13855 mon.a (mon.0) 192 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212135.7385013 mgr.a (mgr.14152) 108 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212136.1384728 mon.a (mon.0) 193 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212136.1432571 mon.e (mon.1) 1 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212137.1386065 mon.a (mon.0) 194 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212137.7389271 mgr.a (mgr.14152) 109 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212138.1387663 mon.a (mon.0) 195 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212138.989348 mon.a (mon.0) 196 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212139.1392963 mon.a (mon.0) 197 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212139.1891005 mon.a (mon.0) 198 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212139.199562 mon.a (mon.0) 199 : cluster 0 monmap e2: 2 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:39.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212139.2197783 mon.a (mon.0) 200 : cluster 0 fsmap 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212139.219835 mon.a (mon.0) 201 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212139.220121 mon.a (mon.0) 202 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: cluster 1689212139.2268438 mon.a (mon.0) 203 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212139.2313154 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212139.2359023 mon.a (mon.0) 205 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212139.2508278 mon.a (mon.0) 206 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:39.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212139.2521687 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:39.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:39 smithi022 bash[26979]: audit 1689212139.25384 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:40.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:40 smithi022 bash[26979]: cephadm 1689212139.258913 mgr.a (mgr.14152) 110 : cephadm 1 Deploying daemon mon.d on smithi137 2023-07-13T01:35:40.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:40 smithi022 bash[26979]: cluster 1689212139.7393835 mgr.a (mgr.14152) 111 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:40.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:40 smithi022 bash[26979]: audit 1689212139.9891489 mon.a (mon.0) 209 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:40.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:40 smithi022 bash[26979]: audit 1689212140.1389656 mon.a (mon.0) 210 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:40.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:40 smithi154 bash[27744]: cephadm 1689212139.258913 mgr.a (mgr.14152) 110 : cephadm 1 Deploying daemon mon.d on smithi137 2023-07-13T01:35:40.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:40 smithi154 bash[27744]: cluster 1689212139.7393835 mgr.a (mgr.14152) 111 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:40.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:40 smithi154 bash[27744]: audit 1689212139.9891489 mon.a (mon.0) 209 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:40.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:40 smithi154 bash[27744]: audit 1689212140.1389656 mon.a (mon.0) 210 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:43.982 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:43 smithi137 systemd[1]: Started Ceph mon.d for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:35:45.068 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.946+0000 7f0498ca0c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-13T01:35:45.068 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.946+0000 7f0498ca0c80 0 ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev), process ceph-mon, pid 7 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.946+0000 7f0498ca0c80 0 pidfile_write: ignore empty --pid-file 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 0 load: jerasure load: lrc 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: RocksDB version: 7.9.2 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Git sha 0 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Compile date 2023-07-12 14:33:48 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: DB SUMMARY 2023-07-13T01:35:45.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: DB Session ID: V5PD0V58CGHMWCH0F6YE 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: CURRENT file: CURRENT 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: IDENTITY file: IDENTITY 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-d/store.db dir, Total Num: 0, files: 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-d/store.db: 000004.log size: 636 ; 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.error_if_exists: 0 2023-07-13T01:35:45.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.create_if_missing: 0 2023-07-13T01:35:45.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.paranoid_checks: 1 2023-07-13T01:35:45.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-07-13T01:35:45.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-13T01:35:45.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-13T01:35:45.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.env: 0x55f2eb7f1720 2023-07-13T01:35:45.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.fs: PosixFileSystem 2023-07-13T01:35:45.072 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.info_log: 0x55f2ee9ed3c0 2023-07-13T01:35:45.072 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-13T01:35:45.072 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.statistics: (nil) 2023-07-13T01:35:45.072 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.use_fsync: 0 2023-07-13T01:35:45.073 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_log_file_size: 0 2023-07-13T01:35:45.073 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-13T01:35:45.073 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-13T01:35:45.073 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-13T01:35:45.073 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-13T01:35:45.074 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.allow_fallocate: 1 2023-07-13T01:35:45.074 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-13T01:35:45.074 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-13T01:35:45.074 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.use_direct_reads: 0 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.create_missing_column_families: 0 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.db_log_dir: 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.wal_dir: 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-13T01:35:45.075 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-13T01:35:45.076 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-13T01:35:45.076 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-13T01:35:45.076 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-13T01:35:45.076 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.advise_random_on_open: 1 2023-07-13T01:35:45.076 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-13T01:35:45.077 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.write_buffer_manager: 0x55f2edc7c5a0 2023-07-13T01:35:45.077 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-13T01:35:45.077 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-13T01:35:45.077 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-13T01:35:45.077 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.rate_limiter: (nil) 2023-07-13T01:35:45.078 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-13T01:35:45.078 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-13T01:35:45.081 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-13T01:35:45.081 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-13T01:35:45.083 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.unordered_write: 0 2023-07-13T01:35:45.083 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-13T01:35:45.084 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-13T01:35:45.084 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-13T01:35:45.084 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-13T01:35:45.084 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.row_cache: None 2023-07-13T01:35:45.084 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.wal_filter: None 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.two_write_queues: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.manual_wal_flush: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.wal_compression: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.atomic_flush: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-13T01:35:45.085 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-13T01:35:45.086 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-13T01:35:45.086 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.log_readahead_size: 0 2023-07-13T01:35:45.086 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-13T01:35:45.086 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-07-13T01:35:45.086 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-13T01:35:45.086 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-13T01:35:45.087 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-07-13T01:35:45.087 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-07-13T01:35:45.087 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-07-13T01:35:45.087 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_background_jobs: 2 2023-07-13T01:35:45.088 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_background_compactions: -1 2023-07-13T01:35:45.088 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_subcompactions: 1 2023-07-13T01:35:45.088 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_total_wal_size: 0 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-13T01:35:45.089 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_open_files: -1 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bytes_per_sync: 0 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_background_flushes: -1 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Compression algorithms supported: 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-13T01:35:45.090 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kZSTD supported: 0 2023-07-13T01:35:45.091 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kXpressCompression supported: 0 2023-07-13T01:35:45.091 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-13T01:35:45.091 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kZlibCompression supported: 1 2023-07-13T01:35:45.091 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kSnappyCompression supported: 1 2023-07-13T01:35:45.091 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kLZ4Compression supported: 1 2023-07-13T01:35:45.092 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: kBZip2Compression supported: 0 2023-07-13T01:35:45.092 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-13T01:35:45.092 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-07-13T01:35:45.092 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-d/store.db/MANIFEST-000005 2023-07-13T01:35:45.092 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-13T01:35:45.092 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.merge_operator: 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_filter: None 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_filter_factory: None 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f2ee9ed4e0) 2023-07-13T01:35:45.093 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cache_index_and_filter_blocks: 1 2023-07-13T01:35:45.094 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-13T01:35:45.094 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-13T01:35:45.094 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: pin_top_level_index_and_filter: 1 2023-07-13T01:35:45.094 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: index_type: 0 2023-07-13T01:35:45.094 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: data_block_index_type: 0 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: index_shortening: 1 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: data_block_hash_table_util_ratio: 0.750000 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: checksum: 4 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: no_block_cache: 0 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_cache: 0x55f2edcfd1f0 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_cache_name: BinnedLRUCache 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_cache_options: 2023-07-13T01:35:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: capacity : 536870912 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: num_shard_bits : 4 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: strict_capacity_limit : 0 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: high_pri_pool_ratio: 0.000 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_cache_compressed: (nil) 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: persistent_cache: (nil) 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_size: 4096 2023-07-13T01:35:45.096 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_size_deviation: 10 2023-07-13T01:35:45.097 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_restart_interval: 16 2023-07-13T01:35:45.097 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: index_block_restart_interval: 1 2023-07-13T01:35:45.097 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: metadata_block_size: 4096 2023-07-13T01:35:45.097 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: partition_filters: 0 2023-07-13T01:35:45.097 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: use_delta_encoding: 1 2023-07-13T01:35:45.097 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: filter_policy: bloomfilter 2023-07-13T01:35:45.098 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: whole_key_filtering: 1 2023-07-13T01:35:45.098 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: verify_compression: 0 2023-07-13T01:35:45.098 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: read_amp_bytes_per_bit: 0 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: format_version: 5 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: enable_index_compression: 1 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: block_align: 0 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: max_auto_readahead_size: 262144 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: prepopulate_block_cache: 0 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: initial_auto_readahead_size: 8192 2023-07-13T01:35:45.099 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: num_file_reads_for_auto_readahead: 2 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression: NoCompression 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-13T01:35:45.100 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.num_levels: 7 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-13T01:35:45.101 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:45.102 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-13T01:35:45.102 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-13T01:35:45.102 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:45.102 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:45.102 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-13T01:35:45.102 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.level: 32767 2023-07-13T01:35:45.103 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-13T01:35:45.103 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-13T01:35:45.103 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:45.103 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:45.103 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-13T01:35:45.103 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.enabled: false 2023-07-13T01:35:45.104 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:45.104 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-13T01:35:45.104 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-13T01:35:45.104 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-13T01:35:45.104 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-13T01:35:45.105 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-13T01:35:45.106 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.arena_block_size: 1048576 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-13T01:35:45.107 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-13T01:35:45.108 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.table_properties_collectors: 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.inplace_update_support: 0 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.bloom_locality: 0 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.max_successive_merges: 0 2023-07-13T01:35:45.109 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-13T01:35:45.110 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-13T01:35:45.110 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.force_consistency_checks: 1 2023-07-13T01:35:45.110 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-13T01:35:45.110 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.ttl: 2592000 2023-07-13T01:35:45.110 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-13T01:35:45.110 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.enable_blob_files: false 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.min_blob_size: 0 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.blob_file_size: 268435456 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-07-13T01:35:45.111 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-d/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-13T01:35:45.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e7371bfb-7c6b-4dde-8924-ffc9608797a5 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212144956360, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.950+0000 7f0498ca0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212144956930, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689212144, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e7371bfb-7c6b-4dde-8924-ffc9608797a5", "db_session_id": "V5PD0V58CGHMWCH0F6YE", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212144957052, "job": 1, "event": "recovery_finished"} 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-d/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f2edd9e000 2023-07-13T01:35:45.113 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 4 rocksdb: DB pointer 0x55f2edd8c000 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f04874b1700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f04874b1700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: ** DB Stats ** 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:45.114 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-13T01:35:45.115 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:45.115 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:45.115 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: ** Compaction Stats [default] ** 2023-07-13T01:35:45.115 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:45.116 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-13T01:35:45.116 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:45.116 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:45.116 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:45.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: ** Compaction Stats [default] ** 2023-07-13T01:35:45.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:45.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-13T01:35:45.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:45.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-13T01:35:45.117 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:45.118 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:45.118 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:45.118 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: AddFile(Total Files): cumulative 0, interval 0 2023-07-13T01:35:45.118 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-13T01:35:45.118 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: AddFile(Keys): cumulative 0, interval 0 2023-07-13T01:35:45.119 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Cumulative compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:45.119 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Interval compaction: 0.00 GB write, 0.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:45.119 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-13T01:35:45.119 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Block cache BinnedLRUCache@0x55f2edcfd1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2023-07-13T01:35:45.119 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: ** File Read Latency Histogram By Level [default] ** 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 0 mon.d does not exist in monmap, will attempt to join an existing cluster 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 0 using public_addr v2:172.21.15.137:0/0 -> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.954+0000 7f0498ca0c80 0 starting mon.d rank -1 at public addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] at bind addrs [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon_data /var/lib/ceph/mon/ceph-d fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.958+0000 7f0498ca0c80 1 mon.d@-1(???) e0 preinit fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 0 mon.d@-1(synchronizing).mds e1 new map 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 0 mon.d@-1(synchronizing).mds e1 print_map 2023-07-13T01:35:45.120 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: e1 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: enable_multiple, ever_enabled_multiple: 1,1 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: legacy client fscid: -1 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: No filesystems configured 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-13T01:35:45.121 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 0 mon.d@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 0 mon.d@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 0 mon.d@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:45.122 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 0 mon.d@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212107.732795 mgr.a (mgr.14152) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212109.733217 mgr.a (mgr.14152) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212111.7337086 mgr.a (mgr.14152) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.180513 mon.a (mon.0) 162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.1852217 mon.a (mon.0) 163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.188719 mon.a (mon.0) 164 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.1917007 mon.a (mon.0) 165 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.123 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.1927395 mon.a (mon.0) 166 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.1943197 mon.a (mon.0) 167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.195549 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212112.1975799 mgr.a (mgr.14152) 88 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212112.3621156 mgr.a (mgr.14152) 89 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212112.5273015 mgr.a (mgr.14152) 90 : cephadm 1 Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212112.6916304 mgr.a (mgr.14152) 91 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:35:45.124 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.7058098 mgr.a (mgr.14152) 92 : audit 0 from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.8605762 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.8637283 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212112.8678522 mon.a (mon.0) 171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212113.7341988 mgr.a (mgr.14152) 93 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212115.734626 mgr.a (mgr.14152) 94 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212117.735026 mgr.a (mgr.14152) 95 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212119.7353377 mgr.a (mgr.14152) 96 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.125 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212121.0212185 mon.a (mon.0) 172 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212121.3399532 mon.a (mon.0) 173 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212121.3400156 mon.a (mon.0) 174 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212121.735698 mgr.a (mgr.14152) 97 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212123.7360883 mgr.a (mgr.14152) 98 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212125.7364872 mgr.a (mgr.14152) 99 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.1217864 mon.a (mon.0) 175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.126 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.1288266 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.7079802 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.7095037 mon.a (mon.0) 178 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.7169654 mon.a (mon.0) 179 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.7195785 mon.a (mon.0) 180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.7206607 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212126.110752 mgr.a (mgr.14152) 100 : audit 0 from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "5;smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212126.1172419 mgr.a (mgr.14152) 101 : cephadm 1 Saving service mon spec with placement smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e;count:5 2023-07-13T01:35:45.127 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212126.7219415 mgr.a (mgr.14152) 102 : cephadm 1 Deploying daemon mon.e on smithi154 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212127.7369199 mgr.a (mgr.14152) 103 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212129.7373247 mgr.a (mgr.14152) 104 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212131.7376676 mgr.a (mgr.14152) 105 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212132.5329711 mon.a (mon.0) 182 : audit 0 from='client.? 172.21.15.154:0/258816646' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212132.9487147 mon.a (mon.0) 183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212132.9538925 mon.a (mon.0) 184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.128 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212132.9595072 mon.a (mon.0) 185 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212132.9605947 mon.a (mon.0) 186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212132.9621654 mon.a (mon.0) 187 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212132.9639223 mgr.a (mgr.14152) 106 : cephadm 1 Deploying daemon mon.c on smithi103 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212134.1444824 mon.a (mon.0) 189 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212134.144811 mon.a (mon.0) 190 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212134.1681206 mon.a (mon.0) 191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212135.13855 mon.a (mon.0) 192 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.129 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212135.7385013 mgr.a (mgr.14152) 108 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212136.1384728 mon.a (mon.0) 193 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212136.1432571 mon.e (mon.1) 1 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212137.1386065 mon.a (mon.0) 194 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212137.7389271 mgr.a (mgr.14152) 109 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212138.1387663 mon.a (mon.0) 195 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212138.989348 mon.a (mon.0) 196 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.1392963 mon.a (mon.0) 197 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.130 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.1891005 mon.a (mon.0) 198 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.199562 mon.a (mon.0) 199 : cluster 0 monmap e2: 2 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.2197783 mon.a (mon.0) 200 : cluster 0 fsmap 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.219835 mon.a (mon.0) 201 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.220121 mon.a (mon.0) 202 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.2268438 mon.a (mon.0) 203 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.2313154 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.2359023 mon.a (mon.0) 205 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.131 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.2508278 mon.a (mon.0) 206 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.2521687 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.25384 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cephadm 1689212139.258913 mgr.a (mgr.14152) 110 : cephadm 1 Deploying daemon mon.d on smithi137 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: cluster 1689212139.7393835 mgr.a (mgr.14152) 111 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212139.9891489 mon.a (mon.0) 209 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: audit 1689212140.1389656 mon.a (mon.0) 210 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:45.132 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.982+0000 7f048a4b7700 1 mon.d@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-13T01:35:45.133 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expand map: {default=false} 2023-07-13T01:35:45.133 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta from 'false' to 'false' 2023-07-13T01:35:45.133 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expanded map: {default=false} 2023-07-13T01:35:45.133 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expand map: {default=info} 2023-07-13T01:35:45.133 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta from 'info' to 'info' 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expanded map: {default=info} 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expand map: {default=daemon} 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expanded map: {default=daemon} 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expand map: {default=debug} 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta from 'debug' to 'debug' 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 20 expand_channel_meta expanded map: {default=debug} 2023-07-13T01:35:45.134 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:44 smithi137 bash[27262]: debug 2023-07-13T01:35:44.986+0000 7f048a4b7700 10 mon.d@-1(synchronizing) e3 handle_conf_change mon_allow_pool_delete 2023-07-13T01:35:46.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212140.9955316 mon.a (mon.0) 212 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:46.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212140.9961758 mon.a (mon.0) 213 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:46.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212140.9971576 mon.e (mon.1) 2 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:46.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212141.0203097 mon.a (mon.0) 214 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212141.0206316 mon.a (mon.0) 215 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:46.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212141.7398436 mgr.a (mgr.14152) 112 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:46.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212141.989404 mon.a (mon.0) 216 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212142.989546 mon.a (mon.0) 217 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212143.7402565 mgr.a (mgr.14152) 113 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212143.9897647 mon.a (mon.0) 218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212144.990059 mon.a (mon.0) 219 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212144.9934206 mon.a (mon.0) 220 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212145.9900978 mon.a (mon.0) 221 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212145.9933975 mon.a (mon.0) 222 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.020326 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.0260777 mon.a (mon.0) 224 : cluster 0 monmap e3: 3 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.0438588 mon.a (mon.0) 225 : cluster 0 fsmap 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.043961 mon.a (mon.0) 226 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.0443141 mon.a (mon.0) 227 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.0448167 mon.a (mon.0) 228 : cluster 3 Health check failed: 1/3 mons down, quorum a,e (MON_DOWN) 2023-07-13T01:35:46.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.0529492 mon.a (mon.0) 229 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,e 2023-07-13T01:35:46.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.0529923 mon.a (mon.0) 230 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,e 2023-07-13T01:35:46.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: cluster 1689212146.053056 mon.a (mon.0) 231 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2023-07-13T01:35:46.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212146.0579321 mon.a (mon.0) 232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:46.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212146.0624647 mon.a (mon.0) 233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:46.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212146.0927138 mon.a (mon.0) 234 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:46.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:46 smithi022 bash[26979]: audit 1689212146.093692 mon.a (mon.0) 235 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:46.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212140.9955316 mon.a (mon.0) 212 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:46.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212140.9961758 mon.a (mon.0) 213 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212140.9971576 mon.e (mon.1) 2 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212141.0203097 mon.a (mon.0) 214 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212141.0206316 mon.a (mon.0) 215 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212141.7398436 mgr.a (mgr.14152) 112 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212141.989404 mon.a (mon.0) 216 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212142.989546 mon.a (mon.0) 217 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212143.7402565 mgr.a (mgr.14152) 113 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212143.9897647 mon.a (mon.0) 218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212144.990059 mon.a (mon.0) 219 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212144.9934206 mon.a (mon.0) 220 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212145.9900978 mon.a (mon.0) 221 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212145.9933975 mon.a (mon.0) 222 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.020326 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:46.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.0260777 mon.a (mon.0) 224 : cluster 0 monmap e3: 3 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.0438588 mon.a (mon.0) 225 : cluster 0 fsmap 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.043961 mon.a (mon.0) 226 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.0443141 mon.a (mon.0) 227 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.0448167 mon.a (mon.0) 228 : cluster 3 Health check failed: 1/3 mons down, quorum a,e (MON_DOWN) 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.0529492 mon.a (mon.0) 229 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,e 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.0529923 mon.a (mon.0) 230 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,e 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: cluster 1689212146.053056 mon.a (mon.0) 231 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2023-07-13T01:35:46.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212146.0579321 mon.a (mon.0) 232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:46.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212146.0624647 mon.a (mon.0) 233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:46.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212146.0927138 mon.a (mon.0) 234 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:46.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:46 smithi154 bash[27744]: audit 1689212146.093692 mon.a (mon.0) 235 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:47.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212134.1444824 mon.a (mon.0) 189 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:47.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212134.144811 mon.a (mon.0) 190 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:47.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212134.1681206 mon.a (mon.0) 191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212135.13855 mon.a (mon.0) 192 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212135.7385013 mgr.a (mgr.14152) 108 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212136.1384728 mon.a (mon.0) 193 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212136.1432571 mon.e (mon.1) 1 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212137.1386065 mon.a (mon.0) 194 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212137.7389271 mgr.a (mgr.14152) 109 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212138.1387663 mon.a (mon.0) 195 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212138.989348 mon.a (mon.0) 196 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.1392963 mon.a (mon.0) 197 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.1891005 mon.a (mon.0) 198 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.199562 mon.a (mon.0) 199 : cluster 0 monmap e2: 2 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.2197783 mon.a (mon.0) 200 : cluster 0 fsmap 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.219835 mon.a (mon.0) 201 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.220121 mon.a (mon.0) 202 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.2268438 mon.a (mon.0) 203 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:47.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.2313154 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:47.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.2359023 mon.a (mon.0) 205 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:47.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.2508278 mon.a (mon.0) 206 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:47.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.2521687 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:47.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.25384 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:47.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cephadm 1689212139.258913 mgr.a (mgr.14152) 110 : cephadm 1 Deploying daemon mon.d on smithi137 2023-07-13T01:35:47.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212139.7393835 mgr.a (mgr.14152) 111 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:47.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212139.9891489 mon.a (mon.0) 209 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212140.1389656 mon.a (mon.0) 210 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212140.9955316 mon.a (mon.0) 212 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:47.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212140.9961758 mon.a (mon.0) 213 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:47.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212140.9971576 mon.e (mon.1) 2 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212141.0203097 mon.a (mon.0) 214 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212141.0206316 mon.a (mon.0) 215 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212141.7398436 mgr.a (mgr.14152) 112 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212141.989404 mon.a (mon.0) 216 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212142.989546 mon.a (mon.0) 217 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212143.7402565 mgr.a (mgr.14152) 113 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212143.9897647 mon.a (mon.0) 218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212144.990059 mon.a (mon.0) 219 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212144.9934206 mon.a (mon.0) 220 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212145.9900978 mon.a (mon.0) 221 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212145.9933975 mon.a (mon.0) 222 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.020326 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.0260777 mon.a (mon.0) 224 : cluster 0 monmap e3: 3 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.0438588 mon.a (mon.0) 225 : cluster 0 fsmap 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.043961 mon.a (mon.0) 226 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:47.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.0443141 mon.a (mon.0) 227 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.0448167 mon.a (mon.0) 228 : cluster 3 Health check failed: 1/3 mons down, quorum a,e (MON_DOWN) 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.0529492 mon.a (mon.0) 229 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,e 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.0529923 mon.a (mon.0) 230 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,e 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: cluster 1689212146.053056 mon.a (mon.0) 231 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212146.0579321 mon.a (mon.0) 232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212146.0624647 mon.a (mon.0) 233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:47.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212146.0927138 mon.a (mon.0) 234 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:47.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:47 smithi103 bash[27315]: audit 1689212146.093692 mon.a (mon.0) 235 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:50.854 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:50 smithi084 systemd[1]: Started Ceph mon.b for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:35:52.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.858+0000 7f3fad997c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-07-13T01:35:52.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.858+0000 7f3fad997c80 0 ceph version 18.0.0-4093-g3990f91a (3990f91ac125621431ef1b77c2fc96421bec9e51) reef (dev), process ceph-mon, pid 7 2023-07-13T01:35:52.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.858+0000 7f3fad997c80 0 pidfile_write: ignore empty --pid-file 2023-07-13T01:35:52.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 0 load: jerasure load: lrc 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: RocksDB version: 7.9.2 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Git sha 0 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Compile date 2023-07-12 14:33:48 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: DB SUMMARY 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: DB Session ID: KCXU7RY1K3ZS34SM1G2K 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: CURRENT file: CURRENT 2023-07-13T01:35:52.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: IDENTITY file: IDENTITY 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 761 ; 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.error_if_exists: 0 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.create_if_missing: 0 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.paranoid_checks: 1 2023-07-13T01:35:52.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-07-13T01:35:52.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-13T01:35:52.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-13T01:35:52.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.env: 0x563a2ba14720 2023-07-13T01:35:52.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.fs: PosixFileSystem 2023-07-13T01:35:52.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.info_log: 0x563a2e0993c0 2023-07-13T01:35:52.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-07-13T01:35:52.160 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.statistics: (nil) 2023-07-13T01:35:52.160 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.use_fsync: 0 2023-07-13T01:35:52.160 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_log_file_size: 0 2023-07-13T01:35:52.162 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-13T01:35:52.162 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-07-13T01:35:52.162 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-07-13T01:35:52.162 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.allow_fallocate: 1 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.use_direct_reads: 0 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.create_missing_column_families: 0 2023-07-13T01:35:52.163 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.db_log_dir: 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.wal_dir: 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-07-13T01:35:52.164 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.advise_random_on_open: 1 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.write_buffer_manager: 0x563a2d328c80 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.rate_limiter: (nil) 2023-07-13T01:35:52.165 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.unordered_write: 0 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-13T01:35:52.166 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-13T01:35:52.167 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-13T01:35:52.167 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.row_cache: None 2023-07-13T01:35:52.167 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.wal_filter: None 2023-07-13T01:35:52.167 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-13T01:35:52.167 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-07-13T01:35:52.167 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.two_write_queues: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.manual_wal_flush: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.wal_compression: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.atomic_flush: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-07-13T01:35:52.168 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.log_readahead_size: 0 2023-07-13T01:35:52.169 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-13T01:35:52.169 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-07-13T01:35:52.169 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-13T01:35:52.169 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-13T01:35:52.169 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_background_jobs: 2 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_background_compactions: -1 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_subcompactions: 1 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-13T01:35:52.170 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_total_wal_size: 0 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-13T01:35:52.171 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_open_files: -1 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bytes_per_sync: 0 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_background_flushes: -1 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Compression algorithms supported: 2023-07-13T01:35:52.172 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kZSTD supported: 0 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kXpressCompression supported: 0 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kZlibCompression supported: 1 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kSnappyCompression supported: 1 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kLZ4Compression supported: 1 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: kBZip2Compression supported: 0 2023-07-13T01:35:52.173 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.merge_operator: 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_filter: None 2023-07-13T01:35:52.174 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_filter_factory: None 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563a2e0994e0) 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cache_index_and_filter_blocks: 1 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-13T01:35:52.175 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: pin_top_level_index_and_filter: 1 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: index_type: 0 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: data_block_index_type: 0 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: index_shortening: 1 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: data_block_hash_table_util_ratio: 0.750000 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: checksum: 4 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: no_block_cache: 0 2023-07-13T01:35:52.176 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_cache: 0x563a2d3a91f0 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_cache_name: BinnedLRUCache 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_cache_options: 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: capacity : 536870912 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: num_shard_bits : 4 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: strict_capacity_limit : 0 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: high_pri_pool_ratio: 0.000 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_cache_compressed: (nil) 2023-07-13T01:35:52.177 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: persistent_cache: (nil) 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_size: 4096 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_size_deviation: 10 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_restart_interval: 16 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: index_block_restart_interval: 1 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: metadata_block_size: 4096 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: partition_filters: 0 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: use_delta_encoding: 1 2023-07-13T01:35:52.178 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: filter_policy: bloomfilter 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: whole_key_filtering: 1 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: verify_compression: 0 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: read_amp_bytes_per_bit: 0 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: format_version: 5 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: enable_index_compression: 1 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: block_align: 0 2023-07-13T01:35:52.179 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: max_auto_readahead_size: 262144 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: prepopulate_block_cache: 0 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: initial_auto_readahead_size: 8192 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: num_file_reads_for_auto_readahead: 2 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression: NoCompression 2023-07-13T01:35:52.180 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.num_levels: 7 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-13T01:35:52.181 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-13T01:35:52.182 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.level: 32767 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-13T01:35:52.183 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.enabled: false 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-07-13T01:35:52.184 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-13T01:35:52.185 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.arena_block_size: 1048576 2023-07-13T01:35:52.186 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-13T01:35:52.187 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-13T01:35:52.188 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-13T01:35:52.188 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-13T01:35:52.188 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-13T01:35:52.188 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-13T01:35:52.188 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-13T01:35:52.188 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.table_properties_collectors: 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.inplace_update_support: 0 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.bloom_locality: 0 2023-07-13T01:35:52.189 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.max_successive_merges: 0 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.force_consistency_checks: 1 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.ttl: 2592000 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-13T01:35:52.190 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.enable_blob_files: false 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.min_blob_size: 0 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.blob_file_size: 268435456 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.862+0000 7f3fad997c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-13T01:35:52.191 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 106ec337-e668-4729-a7fa-f99f7da9ea50 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212151871911, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-13T01:35:52.192 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212151873025, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1872, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 773, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 651, "raw_average_value_size": 130, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689212151, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "106ec337-e668-4729-a7fa-f99f7da9ea50", "db_session_id": "KCXU7RY1K3ZS34SM1G2K", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1689212151873253, "job": 1, "event": "recovery_finished"} 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.866+0000 7f3fad997c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563a2d44a000 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 4 rocksdb: DB pointer 0x563a2d438000 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3f9c1a8700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-13T01:35:52.193 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3f9c1a8700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: ** DB Stats ** 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-13T01:35:52.194 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: ** Compaction Stats [default] ** 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: L0 1/0 1.83 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Sum 1/0 1.83 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:52.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: ** Compaction Stats [default] ** 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Uptime(secs): 0.0 total, 0.0 interval 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Flush(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-13T01:35:52.196 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: AddFile(Total Files): cumulative 0, interval 0 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: AddFile(L0 Files): cumulative 0, interval 0 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: AddFile(Keys): cumulative 0, interval 0 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Cumulative compaction: 0.00 GB write, 0.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Interval compaction: 0.00 GB write, 0.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Block cache BinnedLRUCache@0x563a2d3a91f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.4e-05 secs_since: 0 2023-07-13T01:35:52.197 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-13T01:35:52.198 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: ** File Read Latency Histogram By Level [default] ** 2023-07-13T01:35:52.198 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2023-07-13T01:35:52.198 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 0 using public_addr v2:172.21.15.84:0/0 -> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] 2023-07-13T01:35:52.198 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 0 starting mon.b rank -1 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:52.198 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.870+0000 7f3fad997c80 1 mon.b@-1(???) e0 preinit fsid f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:35:52.198 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 0 mon.b@-1(synchronizing).mds e1 new map 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 0 mon.b@-1(synchronizing).mds e1 print_map 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: e1 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: enable_multiple, ever_enabled_multiple: 1,1 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: legacy client fscid: -1 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: 2023-07-13T01:35:52.199 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: No filesystems configured 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-13T01:35:52.200 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212107.732795 mgr.a (mgr.14152) 85 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212109.733217 mgr.a (mgr.14152) 86 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212111.7337086 mgr.a (mgr.14152) 87 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.180513 mon.a (mon.0) 162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.1852217 mon.a (mon.0) 163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.188719 mon.a (mon.0) 164 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.1917007 mon.a (mon.0) 165 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.1927395 mon.a (mon.0) 166 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.1943197 mon.a (mon.0) 167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.195549 mon.a (mon.0) 168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212112.1975799 mgr.a (mgr.14152) 88 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:35:52.202 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212112.3621156 mgr.a (mgr.14152) 89 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212112.5273015 mgr.a (mgr.14152) 90 : cephadm 1 Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212112.6916304 mgr.a (mgr.14152) 91 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.client.admin.keyring 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.7058098 mgr.a (mgr.14152) 92 : audit 0 from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.8605762 mon.a (mon.0) 169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.8637283 mon.a (mon.0) 170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212112.8678522 mon.a (mon.0) 171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.203 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212113.7341988 mgr.a (mgr.14152) 93 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212115.734626 mgr.a (mgr.14152) 94 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212117.735026 mgr.a (mgr.14152) 95 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212119.7353377 mgr.a (mgr.14152) 96 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212121.0212185 mon.a (mon.0) 172 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212121.3399532 mon.a (mon.0) 173 : audit 1 from='client.? 172.21.15.22:0/2931134435' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212121.3400156 mon.a (mon.0) 174 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.204 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212121.735698 mgr.a (mgr.14152) 97 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212123.7360883 mgr.a (mgr.14152) 98 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212125.7364872 mgr.a (mgr.14152) 99 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.1217864 mon.a (mon.0) 175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.1288266 mon.a (mon.0) 176 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.7079802 mon.a (mon.0) 177 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.7095037 mon.a (mon.0) 178 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:35:52.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.7169654 mon.a (mon.0) 179 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.7195785 mon.a (mon.0) 180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.7206607 mon.a (mon.0) 181 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212126.110752 mgr.a (mgr.14152) 100 : audit 0 from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "5;smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212126.1172419 mgr.a (mgr.14152) 101 : cephadm 1 Saving service mon spec with placement smithi022:172.21.15.22=a;smithi084:172.21.15.84=b;smithi103:172.21.15.103=c;smithi137:172.21.15.137=d;smithi154:172.21.15.154=e;count:5 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212126.7219415 mgr.a (mgr.14152) 102 : cephadm 1 Deploying daemon mon.e on smithi154 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212127.7369199 mgr.a (mgr.14152) 103 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212129.7373247 mgr.a (mgr.14152) 104 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212131.7376676 mgr.a (mgr.14152) 105 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212132.5329711 mon.a (mon.0) 182 : audit 0 from='client.? 172.21.15.154:0/258816646' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212132.9487147 mon.a (mon.0) 183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212132.9538925 mon.a (mon.0) 184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212132.9595072 mon.a (mon.0) 185 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212132.9605947 mon.a (mon.0) 186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212132.9621654 mon.a (mon.0) 187 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:52.207 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212132.9639223 mgr.a (mgr.14152) 106 : cephadm 1 Deploying daemon mon.c on smithi103 2023-07-13T01:35:52.208 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212134.1444824 mon.a (mon.0) 189 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.208 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212134.144811 mon.a (mon.0) 190 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.208 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212134.1681206 mon.a (mon.0) 191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.208 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212135.13855 mon.a (mon.0) 192 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.208 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212135.7385013 mgr.a (mgr.14152) 108 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.208 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212136.1384728 mon.a (mon.0) 193 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.209 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212136.1432571 mon.e (mon.1) 1 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.209 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212137.1386065 mon.a (mon.0) 194 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.209 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212137.7389271 mgr.a (mgr.14152) 109 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.209 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212138.1387663 mon.a (mon.0) 195 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.209 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212138.989348 mon.a (mon.0) 196 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.1392963 mon.a (mon.0) 197 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.1891005 mon.a (mon.0) 198 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.199562 mon.a (mon.0) 199 : cluster 0 monmap e2: 2 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.2197783 mon.a (mon.0) 200 : cluster 0 fsmap 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.219835 mon.a (mon.0) 201 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.220121 mon.a (mon.0) 202 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.2268438 mon.a (mon.0) 203 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:52.210 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.2313154 mon.a (mon.0) 204 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.2359023 mon.a (mon.0) 205 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.2508278 mon.a (mon.0) 206 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.2521687 mon.a (mon.0) 207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.25384 mon.a (mon.0) 208 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cephadm 1689212139.258913 mgr.a (mgr.14152) 110 : cephadm 1 Deploying daemon mon.d on smithi137 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212139.7393835 mgr.a (mgr.14152) 111 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.211 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212139.9891489 mon.a (mon.0) 209 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212140.1389656 mon.a (mon.0) 210 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212140.9955316 mon.a (mon.0) 212 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212140.9961758 mon.a (mon.0) 213 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212140.9971576 mon.e (mon.1) 2 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212141.0203097 mon.a (mon.0) 214 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212141.0206316 mon.a (mon.0) 215 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212141.7398436 mgr.a (mgr.14152) 112 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.212 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212141.989404 mon.a (mon.0) 216 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212142.989546 mon.a (mon.0) 217 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212143.7402565 mgr.a (mgr.14152) 113 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212143.9897647 mon.a (mon.0) 218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212144.990059 mon.a (mon.0) 219 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212144.9934206 mon.a (mon.0) 220 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212145.9900978 mon.a (mon.0) 221 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.213 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212145.9933975 mon.a (mon.0) 222 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.020326 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.0260777 mon.a (mon.0) 224 : cluster 0 monmap e3: 3 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.0438588 mon.a (mon.0) 225 : cluster 0 fsmap 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.043961 mon.a (mon.0) 226 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.0443141 mon.a (mon.0) 227 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.0448167 mon.a (mon.0) 228 : cluster 3 Health check failed: 1/3 mons down, quorum a,e (MON_DOWN) 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.0529492 mon.a (mon.0) 229 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,e 2023-07-13T01:35:52.214 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.0529923 mon.a (mon.0) 230 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,e 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: cluster 1689212146.053056 mon.a (mon.0) 231 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212146.0579321 mon.a (mon.0) 232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212146.0624647 mon.a (mon.0) 233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212146.0927138 mon.a (mon.0) 234 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: audit 1689212146.093692 mon.a (mon.0) 235 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.894+0000 7f3f9f1ae700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-13T01:35:52.215 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expand map: {default=false} 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta from 'false' to 'false' 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expanded map: {default=false} 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expand map: {default=info} 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta from 'info' to 'info' 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expanded map: {default=info} 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expand map: {default=daemon} 2023-07-13T01:35:52.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta from 'daemon' to 'daemon' 2023-07-13T01:35:52.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expanded map: {default=daemon} 2023-07-13T01:35:52.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expand map: {default=debug} 2023-07-13T01:35:52.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta from 'debug' to 'debug' 2023-07-13T01:35:52.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 20 expand_channel_meta expanded map: {default=debug} 2023-07-13T01:35:52.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:51 smithi084 bash[27323]: debug 2023-07-13T01:35:51.898+0000 7f3f9f1ae700 10 mon.b@-1(synchronizing) e4 handle_conf_change mon_allow_pool_delete 2023-07-13T01:35:52.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212140.9955316 mon.a (mon.0) 212 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212140.9961758 mon.a (mon.0) 213 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212140.9971576 mon.e (mon.1) 2 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212141.0203097 mon.a (mon.0) 214 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212141.0206316 mon.a (mon.0) 215 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212141.7398436 mgr.a (mgr.14152) 112 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212141.989404 mon.a (mon.0) 216 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212142.989546 mon.a (mon.0) 217 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212143.7402565 mgr.a (mgr.14152) 113 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212143.9897647 mon.a (mon.0) 218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212144.990059 mon.a (mon.0) 219 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212144.9934206 mon.a (mon.0) 220 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212145.9900978 mon.a (mon.0) 221 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212145.9933975 mon.a (mon.0) 222 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.020326 mon.a (mon.0) 223 : cluster 1 mon.a is new leader, mons a,e in quorum (ranks 0,1) 2023-07-13T01:35:52.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.0260777 mon.a (mon.0) 224 : cluster 0 monmap e3: 3 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.0438588 mon.a (mon.0) 225 : cluster 0 fsmap 2023-07-13T01:35:52.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.043961 mon.a (mon.0) 226 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.0443141 mon.a (mon.0) 227 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.0448167 mon.a (mon.0) 228 : cluster 3 Health check failed: 1/3 mons down, quorum a,e (MON_DOWN) 2023-07-13T01:35:52.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.0529492 mon.a (mon.0) 229 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,e 2023-07-13T01:35:52.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.0529923 mon.a (mon.0) 230 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,e 2023-07-13T01:35:52.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.053056 mon.a (mon.0) 231 : cluster 3 mon.c (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2023-07-13T01:35:52.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212146.0579321 mon.a (mon.0) 232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212146.0624647 mon.a (mon.0) 233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212146.0927138 mon.a (mon.0) 234 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212146.093692 mon.a (mon.0) 235 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:35:52.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212142.9915276 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212146.998976 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212146.9992373 mon.a (mon.0) 240 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212146.9996045 mon.a (mon.0) 241 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212147.0009341 mon.a (mon.0) 242 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212147.0011466 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.325 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212147.0011942 mon.e (mon.1) 3 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.325 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212147.0106895 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.325 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212147.7411497 mgr.a (mgr.14152) 116 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.325 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212147.9903114 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.325 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212147.9935706 mon.a (mon.0) 245 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.325 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212148.9904141 mon.a (mon.0) 246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212148.9939914 mon.a (mon.0) 247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212148.9944117 mon.d (mon.3) 1 : cluster 1 mon.d calling monitor election 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212149.7415204 mgr.a (mgr.14152) 117 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212149.990515 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212149.9940884 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212150.9906912 mon.a (mon.0) 250 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212150.9939961 mon.a (mon.0) 251 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.326 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212151.9094353 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:52.327 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212151.9910393 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.327 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212151.994388 mon.a (mon.0) 254 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.327 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.0238886 mon.a (mon.0) 255 : cluster 1 mon.a is new leader, mons a,e,c,d in quorum (ranks 0,1,2,3) 2023-07-13T01:35:52.327 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.0341647 mon.a (mon.0) 256 : cluster 0 monmap e4: 4 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.327 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.051811 mon.a (mon.0) 257 : cluster 0 fsmap 2023-07-13T01:35:52.327 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.051895 mon.a (mon.0) 258 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.328 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.052206 mon.a (mon.0) 259 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.328 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.0526643 mon.a (mon.0) 260 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,e) 2023-07-13T01:35:52.328 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.0527134 mon.a (mon.0) 261 : cluster 1 Cluster is now healthy 2023-07-13T01:35:52.328 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: cluster 1689212152.0616853 mon.a (mon.0) 262 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:52.328 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212152.0666304 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.328 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212152.0713902 mon.a (mon.0) 264 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.329 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212152.0835533 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.329 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:52 smithi137 bash[27262]: audit 1689212152.0893898 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212142.9915276 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212146.998976 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212146.9992373 mon.a (mon.0) 240 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212146.9996045 mon.a (mon.0) 241 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212147.0009341 mon.a (mon.0) 242 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212147.0011466 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212147.0011942 mon.e (mon.1) 3 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212147.0106895 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212147.7411497 mgr.a (mgr.14152) 116 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212147.9903114 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212147.9935706 mon.a (mon.0) 245 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212148.9904141 mon.a (mon.0) 246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212148.9939914 mon.a (mon.0) 247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212148.9944117 mon.d (mon.3) 1 : cluster 1 mon.d calling monitor election 2023-07-13T01:35:52.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212149.7415204 mgr.a (mgr.14152) 117 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212149.990515 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212149.9940884 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212150.9906912 mon.a (mon.0) 250 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212150.9939961 mon.a (mon.0) 251 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212151.9094353 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:52.373 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212151.9910393 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212151.994388 mon.a (mon.0) 254 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.0238886 mon.a (mon.0) 255 : cluster 1 mon.a is new leader, mons a,e,c,d in quorum (ranks 0,1,2,3) 2023-07-13T01:35:52.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.0341647 mon.a (mon.0) 256 : cluster 0 monmap e4: 4 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.374 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.051811 mon.a (mon.0) 257 : cluster 0 fsmap 2023-07-13T01:35:52.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.051895 mon.a (mon.0) 258 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.052206 mon.a (mon.0) 259 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.0526643 mon.a (mon.0) 260 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,e) 2023-07-13T01:35:52.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.0527134 mon.a (mon.0) 261 : cluster 1 Cluster is now healthy 2023-07-13T01:35:52.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: cluster 1689212152.0616853 mon.a (mon.0) 262 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:52.376 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212152.0666304 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.376 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212152.0713902 mon.a (mon.0) 264 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.376 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212152.0835533 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.377 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:52 smithi103 bash[27315]: audit 1689212152.0893898 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212142.9915276 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212146.998976 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212146.9992373 mon.a (mon.0) 240 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212146.9996045 mon.a (mon.0) 241 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212147.0009341 mon.a (mon.0) 242 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212147.0011466 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212147.0011942 mon.e (mon.1) 3 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212147.0106895 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212147.7411497 mgr.a (mgr.14152) 116 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212147.9903114 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212147.9935706 mon.a (mon.0) 245 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212148.9904141 mon.a (mon.0) 246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212148.9939914 mon.a (mon.0) 247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212148.9944117 mon.d (mon.3) 1 : cluster 1 mon.d calling monitor election 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212149.7415204 mgr.a (mgr.14152) 117 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212149.990515 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212149.9940884 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212150.9906912 mon.a (mon.0) 250 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212150.9939961 mon.a (mon.0) 251 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212151.9094353 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212151.9910393 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212151.994388 mon.a (mon.0) 254 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.0238886 mon.a (mon.0) 255 : cluster 1 mon.a is new leader, mons a,e,c,d in quorum (ranks 0,1,2,3) 2023-07-13T01:35:52.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.0341647 mon.a (mon.0) 256 : cluster 0 monmap e4: 4 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.051811 mon.a (mon.0) 257 : cluster 0 fsmap 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.051895 mon.a (mon.0) 258 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.052206 mon.a (mon.0) 259 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.0526643 mon.a (mon.0) 260 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,e) 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.0527134 mon.a (mon.0) 261 : cluster 1 Cluster is now healthy 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: cluster 1689212152.0616853 mon.a (mon.0) 262 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:52.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212152.0666304 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212152.0713902 mon.a (mon.0) 264 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212152.0835533 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:52 smithi022 bash[26979]: audit 1689212152.0893898 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212142.9915276 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212146.998976 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:52.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212146.9992373 mon.a (mon.0) 240 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212146.9996045 mon.a (mon.0) 241 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212147.0009341 mon.a (mon.0) 242 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212147.0011466 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212147.0011942 mon.e (mon.1) 3 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212147.0106895 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212147.7411497 mgr.a (mgr.14152) 116 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212147.9903114 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212147.9935706 mon.a (mon.0) 245 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212148.9904141 mon.a (mon.0) 246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212148.9939914 mon.a (mon.0) 247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212148.9944117 mon.d (mon.3) 1 : cluster 1 mon.d calling monitor election 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212149.7415204 mgr.a (mgr.14152) 117 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212149.990515 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212149.9940884 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212150.9906912 mon.a (mon.0) 250 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212150.9939961 mon.a (mon.0) 251 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212151.9094353 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212151.9910393 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212151.994388 mon.a (mon.0) 254 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.0238886 mon.a (mon.0) 255 : cluster 1 mon.a is new leader, mons a,e,c,d in quorum (ranks 0,1,2,3) 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.0341647 mon.a (mon.0) 256 : cluster 0 monmap e4: 4 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.051811 mon.a (mon.0) 257 : cluster 0 fsmap 2023-07-13T01:35:52.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.051895 mon.a (mon.0) 258 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.052206 mon.a (mon.0) 259 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.0526643 mon.a (mon.0) 260 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,e) 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.0527134 mon.a (mon.0) 261 : cluster 1 Cluster is now healthy 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: cluster 1689212152.0616853 mon.a (mon.0) 262 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212152.0666304 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212152.0713902 mon.a (mon.0) 264 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212152.0835533 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:52.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:52 smithi154 bash[27744]: audit 1689212152.0893898 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:53.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:53 smithi022 bash[26979]: cluster 1689212151.7418973 mgr.a (mgr.14152) 118 : cluster 0 pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:53.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:53 smithi022 bash[26979]: audit 1689212152.2520957 mon.a (mon.0) 267 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:53.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:53 smithi022 bash[26979]: audit 1689212152.9100666 mon.a (mon.0) 268 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:53.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:53 smithi022 bash[26979]: audit 1689212152.9913788 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:53.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:35:53 smithi022 bash[26979]: audit 1689212152.994703 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:53.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:53 smithi154 bash[27744]: cluster 1689212151.7418973 mgr.a (mgr.14152) 118 : cluster 0 pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:53.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:53 smithi154 bash[27744]: audit 1689212152.2520957 mon.a (mon.0) 267 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:53.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:53 smithi154 bash[27744]: audit 1689212152.9100666 mon.a (mon.0) 268 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:53.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:53 smithi154 bash[27744]: audit 1689212152.9913788 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:53.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:35:53 smithi154 bash[27744]: audit 1689212152.994703 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:53.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:53 smithi137 bash[27262]: cluster 1689212151.7418973 mgr.a (mgr.14152) 118 : cluster 0 pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:53.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:53 smithi137 bash[27262]: audit 1689212152.2520957 mon.a (mon.0) 267 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:53.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:53 smithi137 bash[27262]: audit 1689212152.9100666 mon.a (mon.0) 268 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:53.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:53 smithi137 bash[27262]: audit 1689212152.9913788 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:53.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:35:53 smithi137 bash[27262]: audit 1689212152.994703 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:53.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:53 smithi103 bash[27315]: cluster 1689212151.7418973 mgr.a (mgr.14152) 118 : cluster 0 pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:53.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:53 smithi103 bash[27315]: audit 1689212152.2520957 mon.a (mon.0) 267 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:53.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:53 smithi103 bash[27315]: audit 1689212152.9100666 mon.a (mon.0) 268 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:53.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:53 smithi103 bash[27315]: audit 1689212152.9913788 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:53.618 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:35:53 smithi103 bash[27315]: audit 1689212152.994703 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212142.9915276 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:59.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212146.998976 mon.a (mon.0) 239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-13T01:35:59.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212146.9992373 mon.a (mon.0) 240 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212146.9996045 mon.a (mon.0) 241 : cluster 1 mon.a calling monitor election 2023-07-13T01:35:59.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212147.0009341 mon.a (mon.0) 242 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212147.0011466 mon.a (mon.0) 243 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "e"}]: dispatch 2023-07-13T01:35:59.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212147.0011942 mon.e (mon.1) 3 : cluster 1 mon.e calling monitor election 2023-07-13T01:35:59.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212147.0106895 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2023-07-13T01:35:59.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212147.7411497 mgr.a (mgr.14152) 116 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:59.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212147.9903114 mon.a (mon.0) 244 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212147.9935706 mon.a (mon.0) 245 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212148.9904141 mon.a (mon.0) 246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212148.9939914 mon.a (mon.0) 247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212148.9944117 mon.d (mon.3) 1 : cluster 1 mon.d calling monitor election 2023-07-13T01:35:59.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212149.7415204 mgr.a (mgr.14152) 117 : cluster 0 pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:59.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212149.990515 mon.a (mon.0) 248 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212149.9940884 mon.a (mon.0) 249 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212150.9906912 mon.a (mon.0) 250 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212150.9939961 mon.a (mon.0) 251 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212151.9094353 mon.a (mon.0) 252 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:59.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212151.9910393 mon.a (mon.0) 253 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212151.994388 mon.a (mon.0) 254 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.0238886 mon.a (mon.0) 255 : cluster 1 mon.a is new leader, mons a,e,c,d in quorum (ranks 0,1,2,3) 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.0341647 mon.a (mon.0) 256 : cluster 0 monmap e4: 4 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.051811 mon.a (mon.0) 257 : cluster 0 fsmap 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.051895 mon.a (mon.0) 258 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.052206 mon.a (mon.0) 259 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:35:59.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.0526643 mon.a (mon.0) 260 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,e) 2023-07-13T01:35:59.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.0527134 mon.a (mon.0) 261 : cluster 1 Cluster is now healthy 2023-07-13T01:35:59.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212152.0616853 mon.a (mon.0) 262 : cluster 1 overall HEALTH_OK 2023-07-13T01:35:59.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.0666304 mon.a (mon.0) 263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:59.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.0713902 mon.a (mon.0) 264 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:59.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.0835533 mon.a (mon.0) 265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:59.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.0893898 mon.a (mon.0) 266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:35:59.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: cluster 1689212151.7418973 mgr.a (mgr.14152) 118 : cluster 0 pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:35:59.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.2520957 mon.a (mon.0) 267 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:35:59.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.9100666 mon.a (mon.0) 268 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:35:59.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.9913788 mon.a (mon.0) 269 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-13T01:35:59.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:35:59 smithi084 bash[27323]: audit 1689212152.994703 mon.a (mon.0) 270 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "d"}]: dispatch 2023-07-13T01:35:59.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-07-13T01:35:59.519 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"fsid":"f81712b0-211c-11ee-9b31-001a4aab830c","modified":"2023-07-13T01:35:53.910366Z","created":"2023-07-13T01:32:02.659334Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:3300","nonce":0},{"type":"v1","addr":"172.21.15.137:6789","nonce":0}]},"addr":"172.21.15.137:6789/0","public_addr":"172.21.15.137:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2,3,4]} 2023-07-13T01:35:59.522 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 5 2023-07-13T01:36:00.245 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-07-13T01:36:00.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph config generate-minimal-conf 2023-07-13T01:36:00.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212153.9173908 mon.c (mon.2) 3 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212153.9188254 mon.e (mon.1) 4 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212153.934934 mon.d (mon.3) 2 : cluster 1 mon.d calling monitor election 2023-07-13T01:36:00.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212155.9121614 mon.b (mon.4) 1 : cluster 1 mon.b calling monitor election 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9420753 mon.a (mon.0) 284 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9566438 mon.c (mon.2) 4 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9578607 mon.e (mon.1) 5 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.95984 mon.a (mon.0) 285 : cluster 0 fsmap 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9598954 mon.a (mon.0) 286 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9601963 mon.a (mon.0) 287 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9606361 mon.a (mon.0) 288 : cluster 3 Health check failed: 2/5 mons down, quorum a,e,c (MON_DOWN) 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.964229 mon.a (mon.0) 289 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212158.9646757 mon.a (mon.0) 290 : cluster 1 mon.a calling monitor election 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0167315 mon.a (mon.0) 291 : cluster 1 mon.a is new leader, mons a,e,c,d,b in quorum (ranks 0,1,2,3,4) 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0310376 mon.a (mon.0) 292 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0518336 mon.a (mon.0) 293 : cluster 0 fsmap 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0518897 mon.a (mon.0) 294 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0521688 mon.a (mon.0) 295 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.052506 mon.a (mon.0) 296 : cluster 1 Health check cleared: MON_DOWN (was: 2/5 mons down, quorum a,e,c) 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0525472 mon.a (mon.0) 297 : cluster 1 Cluster is now healthy 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: cluster 1689212159.0584214 mon.a (mon.0) 298 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0624576 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0674074 mon.a (mon.0) 300 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0726397 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0781093 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0836625 mon.a (mon.0) 303 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0892 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0951962 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.0993612 mon.a (mon.0) 306 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.322 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.1040843 mon.a (mon.0) 307 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.5138574 mon.d (mon.3) 3 : audit 0 from='client.? 172.21.15.154:0/3877624000' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:36:00.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.5648627 mon.a (mon.0) 308 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:00.323 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.5666637 mon.a (mon.0) 309 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:00.324 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:00 smithi137 bash[27262]: audit 1689212159.9108381 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:36:00.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212153.9173908 mon.c (mon.2) 3 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212153.9188254 mon.e (mon.1) 4 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212153.934934 mon.d (mon.3) 2 : cluster 1 mon.d calling monitor election 2023-07-13T01:36:00.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212155.9121614 mon.b (mon.4) 1 : cluster 1 mon.b calling monitor election 2023-07-13T01:36:00.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9420753 mon.a (mon.0) 284 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9566438 mon.c (mon.2) 4 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9578607 mon.e (mon.1) 5 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.95984 mon.a (mon.0) 285 : cluster 0 fsmap 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9598954 mon.a (mon.0) 286 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9601963 mon.a (mon.0) 287 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9606361 mon.a (mon.0) 288 : cluster 3 Health check failed: 2/5 mons down, quorum a,e,c (MON_DOWN) 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.964229 mon.a (mon.0) 289 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212158.9646757 mon.a (mon.0) 290 : cluster 1 mon.a calling monitor election 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0167315 mon.a (mon.0) 291 : cluster 1 mon.a is new leader, mons a,e,c,d,b in quorum (ranks 0,1,2,3,4) 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0310376 mon.a (mon.0) 292 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0518336 mon.a (mon.0) 293 : cluster 0 fsmap 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0518897 mon.a (mon.0) 294 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0521688 mon.a (mon.0) 295 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.052506 mon.a (mon.0) 296 : cluster 1 Health check cleared: MON_DOWN (was: 2/5 mons down, quorum a,e,c) 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0525472 mon.a (mon.0) 297 : cluster 1 Cluster is now healthy 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: cluster 1689212159.0584214 mon.a (mon.0) 298 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0624576 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0674074 mon.a (mon.0) 300 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0726397 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0781093 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0836625 mon.a (mon.0) 303 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0892 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0951962 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.0993612 mon.a (mon.0) 306 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.1040843 mon.a (mon.0) 307 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.371 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.5138574 mon.d (mon.3) 3 : audit 0 from='client.? 172.21.15.154:0/3877624000' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:36:00.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.5648627 mon.a (mon.0) 308 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:00.372 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.5666637 mon.a (mon.0) 309 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:00.375 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:00 smithi103 bash[27315]: audit 1689212159.9108381 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:36:00.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212153.9173908 mon.c (mon.2) 3 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212153.9188254 mon.e (mon.1) 4 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212153.934934 mon.d (mon.3) 2 : cluster 1 mon.d calling monitor election 2023-07-13T01:36:00.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212155.9121614 mon.b (mon.4) 1 : cluster 1 mon.b calling monitor election 2023-07-13T01:36:00.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9420753 mon.a (mon.0) 284 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9566438 mon.c (mon.2) 4 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9578607 mon.e (mon.1) 5 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.95984 mon.a (mon.0) 285 : cluster 0 fsmap 2023-07-13T01:36:00.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9598954 mon.a (mon.0) 286 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9601963 mon.a (mon.0) 287 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9606361 mon.a (mon.0) 288 : cluster 3 Health check failed: 2/5 mons down, quorum a,e,c (MON_DOWN) 2023-07-13T01:36:00.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.964229 mon.a (mon.0) 289 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212158.9646757 mon.a (mon.0) 290 : cluster 1 mon.a calling monitor election 2023-07-13T01:36:00.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0167315 mon.a (mon.0) 291 : cluster 1 mon.a is new leader, mons a,e,c,d,b in quorum (ranks 0,1,2,3,4) 2023-07-13T01:36:00.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0310376 mon.a (mon.0) 292 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0518336 mon.a (mon.0) 293 : cluster 0 fsmap 2023-07-13T01:36:00.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0518897 mon.a (mon.0) 294 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0521688 mon.a (mon.0) 295 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.052506 mon.a (mon.0) 296 : cluster 1 Health check cleared: MON_DOWN (was: 2/5 mons down, quorum a,e,c) 2023-07-13T01:36:00.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0525472 mon.a (mon.0) 297 : cluster 1 Cluster is now healthy 2023-07-13T01:36:00.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: cluster 1689212159.0584214 mon.a (mon.0) 298 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.411 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0624576 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0674074 mon.a (mon.0) 300 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0726397 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0781093 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.412 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0836625 mon.a (mon.0) 303 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0892 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0951962 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.0993612 mon.a (mon.0) 306 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.413 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.1040843 mon.a (mon.0) 307 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.414 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.5138574 mon.d (mon.3) 3 : audit 0 from='client.? 172.21.15.154:0/3877624000' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:36:00.414 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.5648627 mon.a (mon.0) 308 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:00.414 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.5666637 mon.a (mon.0) 309 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:00.414 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:00 smithi084 bash[27323]: audit 1689212159.9108381 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:36:00.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212153.9173908 mon.c (mon.2) 3 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212153.9188254 mon.e (mon.1) 4 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212153.934934 mon.d (mon.3) 2 : cluster 1 mon.d calling monitor election 2023-07-13T01:36:00.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212155.9121614 mon.b (mon.4) 1 : cluster 1 mon.b calling monitor election 2023-07-13T01:36:00.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9420753 mon.a (mon.0) 284 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9566438 mon.c (mon.2) 4 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9578607 mon.e (mon.1) 5 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.95984 mon.a (mon.0) 285 : cluster 0 fsmap 2023-07-13T01:36:00.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9598954 mon.a (mon.0) 286 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9601963 mon.a (mon.0) 287 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9606361 mon.a (mon.0) 288 : cluster 3 Health check failed: 2/5 mons down, quorum a,e,c (MON_DOWN) 2023-07-13T01:36:00.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.964229 mon.a (mon.0) 289 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212158.9646757 mon.a (mon.0) 290 : cluster 1 mon.a calling monitor election 2023-07-13T01:36:00.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0167315 mon.a (mon.0) 291 : cluster 1 mon.a is new leader, mons a,e,c,d,b in quorum (ranks 0,1,2,3,4) 2023-07-13T01:36:00.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0310376 mon.a (mon.0) 292 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0518336 mon.a (mon.0) 293 : cluster 0 fsmap 2023-07-13T01:36:00.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0518897 mon.a (mon.0) 294 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0521688 mon.a (mon.0) 295 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.052506 mon.a (mon.0) 296 : cluster 1 Health check cleared: MON_DOWN (was: 2/5 mons down, quorum a,e,c) 2023-07-13T01:36:00.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0525472 mon.a (mon.0) 297 : cluster 1 Cluster is now healthy 2023-07-13T01:36:00.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: cluster 1689212159.0584214 mon.a (mon.0) 298 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.425 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0624576 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0674074 mon.a (mon.0) 300 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0726397 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0781093 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0836625 mon.a (mon.0) 303 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0892 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0951962 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.0993612 mon.a (mon.0) 306 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.426 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.1040843 mon.a (mon.0) 307 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.5138574 mon.d (mon.3) 3 : audit 0 from='client.? 172.21.15.154:0/3877624000' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:36:00.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.5648627 mon.a (mon.0) 308 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:00.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.5666637 mon.a (mon.0) 309 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:00.427 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:00 smithi022 bash[26979]: audit 1689212159.9108381 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:36:00.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212153.9173908 mon.c (mon.2) 3 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212153.9188254 mon.e (mon.1) 4 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212153.934934 mon.d (mon.3) 2 : cluster 1 mon.d calling monitor election 2023-07-13T01:36:00.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212155.9121614 mon.b (mon.4) 1 : cluster 1 mon.b calling monitor election 2023-07-13T01:36:00.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9420753 mon.a (mon.0) 284 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9566438 mon.c (mon.2) 4 : cluster 1 mon.c calling monitor election 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9578607 mon.e (mon.1) 5 : cluster 1 mon.e calling monitor election 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.95984 mon.a (mon.0) 285 : cluster 0 fsmap 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9598954 mon.a (mon.0) 286 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9601963 mon.a (mon.0) 287 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9606361 mon.a (mon.0) 288 : cluster 3 Health check failed: 2/5 mons down, quorum a,e,c (MON_DOWN) 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.964229 mon.a (mon.0) 289 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212158.9646757 mon.a (mon.0) 290 : cluster 1 mon.a calling monitor election 2023-07-13T01:36:00.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0167315 mon.a (mon.0) 291 : cluster 1 mon.a is new leader, mons a,e,c,d,b in quorum (ranks 0,1,2,3,4) 2023-07-13T01:36:00.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0310376 mon.a (mon.0) 292 : cluster 0 monmap e5: 5 mons at {a=[v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0],b=[v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0],c=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0],d=[v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0],e=[v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0]} removed_ranks: {} 2023-07-13T01:36:00.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0518336 mon.a (mon.0) 293 : cluster 0 fsmap 2023-07-13T01:36:00.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0518897 mon.a (mon.0) 294 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-07-13T01:36:00.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0521688 mon.a (mon.0) 295 : cluster 0 mgrmap e13: a(active, since 2m) 2023-07-13T01:36:00.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.052506 mon.a (mon.0) 296 : cluster 1 Health check cleared: MON_DOWN (was: 2/5 mons down, quorum a,e,c) 2023-07-13T01:36:00.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0525472 mon.a (mon.0) 297 : cluster 1 Cluster is now healthy 2023-07-13T01:36:00.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: cluster 1689212159.0584214 mon.a (mon.0) 298 : cluster 1 overall HEALTH_OK 2023-07-13T01:36:00.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0624576 mon.a (mon.0) 299 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0674074 mon.a (mon.0) 300 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0726397 mon.a (mon.0) 301 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0781093 mon.a (mon.0) 302 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0836625 mon.a (mon.0) 303 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0892 mon.a (mon.0) 304 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0951962 mon.a (mon.0) 305 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.0993612 mon.a (mon.0) 306 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.1040843 mon.a (mon.0) 307 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:00.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.5138574 mon.d (mon.3) 3 : audit 0 from='client.? 172.21.15.154:0/3877624000' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-13T01:36:00.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.5648627 mon.a (mon.0) 308 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:00.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.5666637 mon.a (mon.0) 309 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:00.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:00 smithi154 bash[27744]: audit 1689212159.9108381 mon.a (mon.0) 310 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-13T01:36:01.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.5693038 mgr.a (mgr.14152) 122 : cephadm 1 Updating smithi022:/etc/ceph/ceph.conf 2023-07-13T01:36:01.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.5704095 mgr.a (mgr.14152) 123 : cephadm 1 Updating smithi084:/etc/ceph/ceph.conf 2023-07-13T01:36:01.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.5718367 mgr.a (mgr.14152) 124 : cephadm 1 Updating smithi103:/etc/ceph/ceph.conf 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.5724573 mgr.a (mgr.14152) 125 : cephadm 1 Updating smithi137:/etc/ceph/ceph.conf 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.5731792 mgr.a (mgr.14152) 126 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cluster 1689212159.7436092 mgr.a (mgr.14152) 127 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.9368944 mgr.a (mgr.14152) 128 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.9379692 mgr.a (mgr.14152) 129 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.9399977 mgr.a (mgr.14152) 130 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.940962 mgr.a (mgr.14152) 131 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: cephadm 1689212159.9903812 mgr.a (mgr.14152) 132 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.3130827 mon.a (mon.0) 311 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.3174896 mon.a (mon.0) 312 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.321254 mon.a (mon.0) 313 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.3247964 mon.a (mon.0) 314 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.360184 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.365173 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.3686278 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.372129 mon.a (mon.0) 318 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.3750687 mon.a (mon.0) 319 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.3781037 mon.a (mon.0) 320 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.38335 mon.a (mon.0) 321 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.5468433 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:01.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.5485048 mon.a (mon.0) 323 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:01.173 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:01 smithi022 bash[26979]: audit 1689212160.5500119 mon.a (mon.0) 324 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:01.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.5693038 mgr.a (mgr.14152) 122 : cephadm 1 Updating smithi022:/etc/ceph/ceph.conf 2023-07-13T01:36:01.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.5704095 mgr.a (mgr.14152) 123 : cephadm 1 Updating smithi084:/etc/ceph/ceph.conf 2023-07-13T01:36:01.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.5718367 mgr.a (mgr.14152) 124 : cephadm 1 Updating smithi103:/etc/ceph/ceph.conf 2023-07-13T01:36:01.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.5724573 mgr.a (mgr.14152) 125 : cephadm 1 Updating smithi137:/etc/ceph/ceph.conf 2023-07-13T01:36:01.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.5731792 mgr.a (mgr.14152) 126 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:36:01.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cluster 1689212159.7436092 mgr.a (mgr.14152) 127 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.9368944 mgr.a (mgr.14152) 128 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.9379692 mgr.a (mgr.14152) 129 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.9399977 mgr.a (mgr.14152) 130 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.940962 mgr.a (mgr.14152) 131 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: cephadm 1689212159.9903812 mgr.a (mgr.14152) 132 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.3130827 mon.a (mon.0) 311 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.3174896 mon.a (mon.0) 312 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.321254 mon.a (mon.0) 313 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.3247964 mon.a (mon.0) 314 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.360184 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.365173 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.3686278 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.372129 mon.a (mon.0) 318 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.3750687 mon.a (mon.0) 319 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.3781037 mon.a (mon.0) 320 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.38335 mon.a (mon.0) 321 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.5468433 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:01.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.5485048 mon.a (mon.0) 323 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:01.321 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:01 smithi137 bash[27262]: audit 1689212160.5500119 mon.a (mon.0) 324 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:01.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.5693038 mgr.a (mgr.14152) 122 : cephadm 1 Updating smithi022:/etc/ceph/ceph.conf 2023-07-13T01:36:01.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.5704095 mgr.a (mgr.14152) 123 : cephadm 1 Updating smithi084:/etc/ceph/ceph.conf 2023-07-13T01:36:01.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.5718367 mgr.a (mgr.14152) 124 : cephadm 1 Updating smithi103:/etc/ceph/ceph.conf 2023-07-13T01:36:01.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.5724573 mgr.a (mgr.14152) 125 : cephadm 1 Updating smithi137:/etc/ceph/ceph.conf 2023-07-13T01:36:01.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.5731792 mgr.a (mgr.14152) 126 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:36:01.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cluster 1689212159.7436092 mgr.a (mgr.14152) 127 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:01.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.9368944 mgr.a (mgr.14152) 128 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.9379692 mgr.a (mgr.14152) 129 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.9399977 mgr.a (mgr.14152) 130 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.940962 mgr.a (mgr.14152) 131 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: cephadm 1689212159.9903812 mgr.a (mgr.14152) 132 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.3130827 mon.a (mon.0) 311 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.3174896 mon.a (mon.0) 312 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.321254 mon.a (mon.0) 313 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.3247964 mon.a (mon.0) 314 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.360184 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.365173 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.3686278 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.372129 mon.a (mon.0) 318 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.3750687 mon.a (mon.0) 319 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.3781037 mon.a (mon.0) 320 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.38335 mon.a (mon.0) 321 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.5468433 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:01.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.5485048 mon.a (mon.0) 323 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:01.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:01 smithi103 bash[27315]: audit 1689212160.5500119 mon.a (mon.0) 324 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:01.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.5693038 mgr.a (mgr.14152) 122 : cephadm 1 Updating smithi022:/etc/ceph/ceph.conf 2023-07-13T01:36:01.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.5704095 mgr.a (mgr.14152) 123 : cephadm 1 Updating smithi084:/etc/ceph/ceph.conf 2023-07-13T01:36:01.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.5718367 mgr.a (mgr.14152) 124 : cephadm 1 Updating smithi103:/etc/ceph/ceph.conf 2023-07-13T01:36:01.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.5724573 mgr.a (mgr.14152) 125 : cephadm 1 Updating smithi137:/etc/ceph/ceph.conf 2023-07-13T01:36:01.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.5731792 mgr.a (mgr.14152) 126 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:36:01.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cluster 1689212159.7436092 mgr.a (mgr.14152) 127 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:01.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.9368944 mgr.a (mgr.14152) 128 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.9379692 mgr.a (mgr.14152) 129 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.9399977 mgr.a (mgr.14152) 130 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.940962 mgr.a (mgr.14152) 131 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: cephadm 1689212159.9903812 mgr.a (mgr.14152) 132 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.3130827 mon.a (mon.0) 311 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.3174896 mon.a (mon.0) 312 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.321254 mon.a (mon.0) 313 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.3247964 mon.a (mon.0) 314 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.360184 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.365173 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.3686278 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.372129 mon.a (mon.0) 318 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.3750687 mon.a (mon.0) 319 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.3781037 mon.a (mon.0) 320 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.38335 mon.a (mon.0) 321 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.409 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.5468433 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:01.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.5485048 mon.a (mon.0) 323 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:01.410 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:01 smithi084 bash[27323]: audit 1689212160.5500119 mon.a (mon.0) 324 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:01.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.5693038 mgr.a (mgr.14152) 122 : cephadm 1 Updating smithi022:/etc/ceph/ceph.conf 2023-07-13T01:36:01.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.5704095 mgr.a (mgr.14152) 123 : cephadm 1 Updating smithi084:/etc/ceph/ceph.conf 2023-07-13T01:36:01.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.5718367 mgr.a (mgr.14152) 124 : cephadm 1 Updating smithi103:/etc/ceph/ceph.conf 2023-07-13T01:36:01.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.5724573 mgr.a (mgr.14152) 125 : cephadm 1 Updating smithi137:/etc/ceph/ceph.conf 2023-07-13T01:36:01.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.5731792 mgr.a (mgr.14152) 126 : cephadm 1 Updating smithi154:/etc/ceph/ceph.conf 2023-07-13T01:36:01.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cluster 1689212159.7436092 mgr.a (mgr.14152) 127 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:01.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.9368944 mgr.a (mgr.14152) 128 : cephadm 1 Updating smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.9379692 mgr.a (mgr.14152) 129 : cephadm 1 Updating smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.9399977 mgr.a (mgr.14152) 130 : cephadm 1 Updating smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.940962 mgr.a (mgr.14152) 131 : cephadm 1 Updating smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: cephadm 1689212159.9903812 mgr.a (mgr.14152) 132 : cephadm 1 Updating smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/config/ceph.conf 2023-07-13T01:36:01.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.3130827 mon.a (mon.0) 311 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.3174896 mon.a (mon.0) 312 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.321254 mon.a (mon.0) 313 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.3247964 mon.a (mon.0) 314 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.360184 mon.a (mon.0) 315 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.365173 mon.a (mon.0) 316 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.3686278 mon.a (mon.0) 317 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.372129 mon.a (mon.0) 318 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.3750687 mon.a (mon.0) 319 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.3781037 mon.a (mon.0) 320 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.38335 mon.a (mon.0) 321 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:01.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.5468433 mon.a (mon.0) 322 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:01.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.5485048 mon.a (mon.0) 323 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:01.526 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:01 smithi154 bash[27744]: audit 1689212160.5500119 mon.a (mon.0) 324 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:02.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:02 smithi137 bash[27262]: cephadm 1689212160.546193 mgr.a (mgr.14152) 133 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2023-07-13T01:36:02.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:02 smithi137 bash[27262]: cephadm 1689212160.551683 mgr.a (mgr.14152) 134 : cephadm 1 Reconfiguring daemon mon.a on smithi022 2023-07-13T01:36:02.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:02 smithi022 bash[26979]: cephadm 1689212160.546193 mgr.a (mgr.14152) 133 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2023-07-13T01:36:02.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:02 smithi022 bash[26979]: cephadm 1689212160.551683 mgr.a (mgr.14152) 134 : cephadm 1 Reconfiguring daemon mon.a on smithi022 2023-07-13T01:36:02.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:02 smithi103 bash[27315]: cephadm 1689212160.546193 mgr.a (mgr.14152) 133 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2023-07-13T01:36:02.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:02 smithi103 bash[27315]: cephadm 1689212160.551683 mgr.a (mgr.14152) 134 : cephadm 1 Reconfiguring daemon mon.a on smithi022 2023-07-13T01:36:02.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:02 smithi084 bash[27323]: cephadm 1689212160.546193 mgr.a (mgr.14152) 133 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2023-07-13T01:36:02.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:02 smithi084 bash[27323]: cephadm 1689212160.551683 mgr.a (mgr.14152) 134 : cephadm 1 Reconfiguring daemon mon.a on smithi022 2023-07-13T01:36:02.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:02 smithi154 bash[27744]: cephadm 1689212160.546193 mgr.a (mgr.14152) 133 : cephadm 1 Reconfiguring mon.a (unknown last config time)... 2023-07-13T01:36:02.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:02 smithi154 bash[27744]: cephadm 1689212160.551683 mgr.a (mgr.14152) 134 : cephadm 1 Reconfiguring daemon mon.a on smithi022 2023-07-13T01:36:03.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:03 smithi137 bash[27262]: cluster 1689212161.7440386 mgr.a (mgr.14152) 135 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:03.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:03 smithi137 bash[27262]: audit 1689212162.8114626 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:03 smithi137 bash[27262]: audit 1689212162.8177907 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:03 smithi137 bash[27262]: audit 1689212162.821858 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:03.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:03 smithi137 bash[27262]: audit 1689212162.8231525 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:03.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:03 smithi137 bash[27262]: audit 1689212162.824274 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:03.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:03 smithi103 bash[27315]: cluster 1689212161.7440386 mgr.a (mgr.14152) 135 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:03.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:03 smithi103 bash[27315]: audit 1689212162.8114626 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:03 smithi103 bash[27315]: audit 1689212162.8177907 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:03 smithi103 bash[27315]: audit 1689212162.821858 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:03.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:03 smithi103 bash[27315]: audit 1689212162.8231525 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:03.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:03 smithi103 bash[27315]: audit 1689212162.824274 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:03.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:03 smithi084 bash[27323]: cluster 1689212161.7440386 mgr.a (mgr.14152) 135 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:03.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:03 smithi084 bash[27323]: audit 1689212162.8114626 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:03 smithi084 bash[27323]: audit 1689212162.8177907 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:03 smithi084 bash[27323]: audit 1689212162.821858 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:03.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:03 smithi084 bash[27323]: audit 1689212162.8231525 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:03.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:03 smithi084 bash[27323]: audit 1689212162.824274 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:03.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:03 smithi022 bash[26979]: cluster 1689212161.7440386 mgr.a (mgr.14152) 135 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:03.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:03 smithi022 bash[26979]: audit 1689212162.8114626 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:03 smithi022 bash[26979]: audit 1689212162.8177907 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:03 smithi022 bash[26979]: audit 1689212162.821858 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:03.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:03 smithi022 bash[26979]: audit 1689212162.8231525 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:03.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:03 smithi022 bash[26979]: audit 1689212162.824274 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:03.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:03 smithi154 bash[27744]: cluster 1689212161.7440386 mgr.a (mgr.14152) 135 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:03.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:03 smithi154 bash[27744]: audit 1689212162.8114626 mon.a (mon.0) 325 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:03 smithi154 bash[27744]: audit 1689212162.8177907 mon.a (mon.0) 326 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:03.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:03 smithi154 bash[27744]: audit 1689212162.821858 mon.a (mon.0) 327 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:03.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:03 smithi154 bash[27744]: audit 1689212162.8231525 mon.a (mon.0) 328 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:03.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:03 smithi154 bash[27744]: audit 1689212162.824274 mon.a (mon.0) 329 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:04.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:04 smithi137 bash[27262]: cephadm 1689212162.8213835 mgr.a (mgr.14152) 136 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2023-07-13T01:36:04.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:04 smithi137 bash[27262]: cephadm 1689212162.8255978 mgr.a (mgr.14152) 137 : cephadm 1 Reconfiguring daemon mon.b on smithi084 2023-07-13T01:36:04.357 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:04 smithi084 bash[27323]: cephadm 1689212162.8213835 mgr.a (mgr.14152) 136 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2023-07-13T01:36:04.357 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:04 smithi084 bash[27323]: cephadm 1689212162.8255978 mgr.a (mgr.14152) 137 : cephadm 1 Reconfiguring daemon mon.b on smithi084 2023-07-13T01:36:04.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:04 smithi103 bash[27315]: cephadm 1689212162.8213835 mgr.a (mgr.14152) 136 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2023-07-13T01:36:04.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:04 smithi103 bash[27315]: cephadm 1689212162.8255978 mgr.a (mgr.14152) 137 : cephadm 1 Reconfiguring daemon mon.b on smithi084 2023-07-13T01:36:04.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:04 smithi022 bash[26979]: cephadm 1689212162.8213835 mgr.a (mgr.14152) 136 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2023-07-13T01:36:04.421 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:04 smithi022 bash[26979]: cephadm 1689212162.8255978 mgr.a (mgr.14152) 137 : cephadm 1 Reconfiguring daemon mon.b on smithi084 2023-07-13T01:36:04.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:04 smithi154 bash[27744]: cephadm 1689212162.8213835 mgr.a (mgr.14152) 136 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2023-07-13T01:36:04.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:04 smithi154 bash[27744]: cephadm 1689212162.8255978 mgr.a (mgr.14152) 137 : cephadm 1 Reconfiguring daemon mon.b on smithi084 2023-07-13T01:36:04.931 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:36:05.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:05 smithi137 bash[27262]: cluster 1689212163.744515 mgr.a (mgr.14152) 138 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:05.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:05 smithi137 bash[27262]: audit 1689212164.7853758 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:05 smithi137 bash[27262]: audit 1689212164.7913525 mon.a (mon.0) 331 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:05 smithi137 bash[27262]: audit 1689212164.7959933 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:05.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:05 smithi137 bash[27262]: audit 1689212164.797397 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:05.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:05 smithi137 bash[27262]: audit 1689212164.7987776 mon.a (mon.0) 334 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:05.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:05 smithi103 bash[27315]: cluster 1689212163.744515 mgr.a (mgr.14152) 138 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:05.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:05 smithi103 bash[27315]: audit 1689212164.7853758 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:05 smithi103 bash[27315]: audit 1689212164.7913525 mon.a (mon.0) 331 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:05 smithi103 bash[27315]: audit 1689212164.7959933 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:05.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:05 smithi103 bash[27315]: audit 1689212164.797397 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:05.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:05 smithi103 bash[27315]: audit 1689212164.7987776 mon.a (mon.0) 334 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:05.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:05 smithi084 bash[27323]: cluster 1689212163.744515 mgr.a (mgr.14152) 138 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:05.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:05 smithi084 bash[27323]: audit 1689212164.7853758 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:05 smithi084 bash[27323]: audit 1689212164.7913525 mon.a (mon.0) 331 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:05 smithi084 bash[27323]: audit 1689212164.7959933 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:05.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:05 smithi084 bash[27323]: audit 1689212164.797397 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:05.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:05 smithi084 bash[27323]: audit 1689212164.7987776 mon.a (mon.0) 334 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:05.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:05 smithi022 bash[26979]: cluster 1689212163.744515 mgr.a (mgr.14152) 138 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:05.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:05 smithi022 bash[26979]: audit 1689212164.7853758 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:05 smithi022 bash[26979]: audit 1689212164.7913525 mon.a (mon.0) 331 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:05 smithi022 bash[26979]: audit 1689212164.7959933 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:05.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:05 smithi022 bash[26979]: audit 1689212164.797397 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:05.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:05 smithi022 bash[26979]: audit 1689212164.7987776 mon.a (mon.0) 334 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:05.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:05 smithi154 bash[27744]: cluster 1689212163.744515 mgr.a (mgr.14152) 138 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:05.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:05 smithi154 bash[27744]: audit 1689212164.7853758 mon.a (mon.0) 330 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:05 smithi154 bash[27744]: audit 1689212164.7913525 mon.a (mon.0) 331 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:05.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:05 smithi154 bash[27744]: audit 1689212164.7959933 mon.a (mon.0) 332 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:05.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:05 smithi154 bash[27744]: audit 1689212164.797397 mon.a (mon.0) 333 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:05.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:05 smithi154 bash[27744]: audit 1689212164.7987776 mon.a (mon.0) 334 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:06.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:06 smithi022 bash[26979]: cephadm 1689212164.795509 mgr.a (mgr.14152) 139 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2023-07-13T01:36:06.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:06 smithi022 bash[26979]: cephadm 1689212164.800322 mgr.a (mgr.14152) 140 : cephadm 1 Reconfiguring daemon mon.c on smithi103 2023-07-13T01:36:06.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:06 smithi137 bash[27262]: cephadm 1689212164.795509 mgr.a (mgr.14152) 139 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2023-07-13T01:36:06.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:06 smithi137 bash[27262]: cephadm 1689212164.800322 mgr.a (mgr.14152) 140 : cephadm 1 Reconfiguring daemon mon.c on smithi103 2023-07-13T01:36:06.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:06 smithi103 bash[27315]: cephadm 1689212164.795509 mgr.a (mgr.14152) 139 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2023-07-13T01:36:06.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:06 smithi103 bash[27315]: cephadm 1689212164.800322 mgr.a (mgr.14152) 140 : cephadm 1 Reconfiguring daemon mon.c on smithi103 2023-07-13T01:36:06.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:06 smithi084 bash[27323]: cephadm 1689212164.795509 mgr.a (mgr.14152) 139 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2023-07-13T01:36:06.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:06 smithi084 bash[27323]: cephadm 1689212164.800322 mgr.a (mgr.14152) 140 : cephadm 1 Reconfiguring daemon mon.c on smithi103 2023-07-13T01:36:06.519 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:06 smithi154 bash[27744]: cephadm 1689212164.795509 mgr.a (mgr.14152) 139 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2023-07-13T01:36:06.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:06 smithi154 bash[27744]: cephadm 1689212164.800322 mgr.a (mgr.14152) 140 : cephadm 1 Reconfiguring daemon mon.c on smithi103 2023-07-13T01:36:07.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:07 smithi137 bash[27262]: cluster 1689212165.7449515 mgr.a (mgr.14152) 141 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:07.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:07 smithi137 bash[27262]: audit 1689212166.8108344 mon.a (mon.0) 335 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:07 smithi137 bash[27262]: audit 1689212166.8175728 mon.a (mon.0) 336 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:07 smithi137 bash[27262]: audit 1689212166.8691163 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:07.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:07 smithi137 bash[27262]: audit 1689212166.8711498 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:07.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:07 smithi137 bash[27262]: audit 1689212166.8730435 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:07.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:07 smithi103 bash[27315]: cluster 1689212165.7449515 mgr.a (mgr.14152) 141 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:07.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:07 smithi103 bash[27315]: audit 1689212166.8108344 mon.a (mon.0) 335 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:07 smithi103 bash[27315]: audit 1689212166.8175728 mon.a (mon.0) 336 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:07 smithi103 bash[27315]: audit 1689212166.8691163 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:07.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:07 smithi103 bash[27315]: audit 1689212166.8711498 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:07.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:07 smithi103 bash[27315]: audit 1689212166.8730435 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:07.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:07 smithi084 bash[27323]: cluster 1689212165.7449515 mgr.a (mgr.14152) 141 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:07.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:07 smithi084 bash[27323]: audit 1689212166.8108344 mon.a (mon.0) 335 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:07 smithi084 bash[27323]: audit 1689212166.8175728 mon.a (mon.0) 336 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:07 smithi084 bash[27323]: audit 1689212166.8691163 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:07.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:07 smithi084 bash[27323]: audit 1689212166.8711498 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:07.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:07 smithi084 bash[27323]: audit 1689212166.8730435 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:07.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:07 smithi022 bash[26979]: cluster 1689212165.7449515 mgr.a (mgr.14152) 141 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:07.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:07 smithi022 bash[26979]: audit 1689212166.8108344 mon.a (mon.0) 335 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:07 smithi022 bash[26979]: audit 1689212166.8175728 mon.a (mon.0) 336 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:07 smithi022 bash[26979]: audit 1689212166.8691163 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:07.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:07 smithi022 bash[26979]: audit 1689212166.8711498 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:07.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:07 smithi022 bash[26979]: audit 1689212166.8730435 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:07.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:07 smithi154 bash[27744]: cluster 1689212165.7449515 mgr.a (mgr.14152) 141 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:07.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:07 smithi154 bash[27744]: audit 1689212166.8108344 mon.a (mon.0) 335 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:07 smithi154 bash[27744]: audit 1689212166.8175728 mon.a (mon.0) 336 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:07.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:07 smithi154 bash[27744]: audit 1689212166.8691163 mon.a (mon.0) 337 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:07.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:07 smithi154 bash[27744]: audit 1689212166.8711498 mon.a (mon.0) 338 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:07.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:07 smithi154 bash[27744]: audit 1689212166.8730435 mon.a (mon.0) 339 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:08.009 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:36:08.009 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2023-07-13T01:36:08.009 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = f81712b0-211c-11ee-9b31-001a4aab830c 2023-07-13T01:36:08.009 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2023-07-13T01:36:08.363 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:08 smithi137 bash[27262]: cephadm 1689212166.8684387 mgr.a (mgr.14152) 142 : cephadm 1 Reconfiguring mon.d (monmap changed)... 2023-07-13T01:36:08.364 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:08 smithi137 bash[27262]: cephadm 1689212166.8749962 mgr.a (mgr.14152) 143 : cephadm 1 Reconfiguring daemon mon.d on smithi137 2023-07-13T01:36:08.364 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:08 smithi137 bash[27262]: audit 1689212168.0052912 mon.b (mon.4) 2 : audit 0 from='client.? 172.21.15.22:0/300012063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:08.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:08 smithi103 bash[27315]: cephadm 1689212166.8684387 mgr.a (mgr.14152) 142 : cephadm 1 Reconfiguring mon.d (monmap changed)... 2023-07-13T01:36:08.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:08 smithi103 bash[27315]: cephadm 1689212166.8749962 mgr.a (mgr.14152) 143 : cephadm 1 Reconfiguring daemon mon.d on smithi137 2023-07-13T01:36:08.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:08 smithi103 bash[27315]: audit 1689212168.0052912 mon.b (mon.4) 2 : audit 0 from='client.? 172.21.15.22:0/300012063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:08.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:08 smithi084 bash[27323]: cephadm 1689212166.8684387 mgr.a (mgr.14152) 142 : cephadm 1 Reconfiguring mon.d (monmap changed)... 2023-07-13T01:36:08.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:08 smithi084 bash[27323]: cephadm 1689212166.8749962 mgr.a (mgr.14152) 143 : cephadm 1 Reconfiguring daemon mon.d on smithi137 2023-07-13T01:36:08.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:08 smithi084 bash[27323]: audit 1689212168.0052912 mon.b (mon.4) 2 : audit 0 from='client.? 172.21.15.22:0/300012063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:08.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:08 smithi022 bash[26979]: cephadm 1689212166.8684387 mgr.a (mgr.14152) 142 : cephadm 1 Reconfiguring mon.d (monmap changed)... 2023-07-13T01:36:08.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:08 smithi022 bash[26979]: cephadm 1689212166.8749962 mgr.a (mgr.14152) 143 : cephadm 1 Reconfiguring daemon mon.d on smithi137 2023-07-13T01:36:08.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:08 smithi022 bash[26979]: audit 1689212168.0052912 mon.b (mon.4) 2 : audit 0 from='client.? 172.21.15.22:0/300012063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:08.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:08 smithi154 bash[27744]: cephadm 1689212166.8684387 mgr.a (mgr.14152) 142 : cephadm 1 Reconfiguring mon.d (monmap changed)... 2023-07-13T01:36:08.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:08 smithi154 bash[27744]: cephadm 1689212166.8749962 mgr.a (mgr.14152) 143 : cephadm 1 Reconfiguring daemon mon.d on smithi137 2023-07-13T01:36:08.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:08 smithi154 bash[27744]: audit 1689212168.0052912 mon.b (mon.4) 2 : audit 0 from='client.? 172.21.15.22:0/300012063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:08.627 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-07-13T01:36:08.628 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:36:08.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2023-07-13T01:36:08.639 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:36:08.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:36:08.697 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:36:08.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2023-07-13T01:36:08.716 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:36:08.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:36:08.774 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:36:08.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2023-07-13T01:36:08.792 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:36:08.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:36:08.849 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:36:08.850 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.conf 2023-07-13T01:36:08.865 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:36:08.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:36:08.924 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:36:08.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2023-07-13T01:36:08.941 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:36:08.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-13T01:36:08.998 INFO:tasks.cephadm:Adding mgr.a on smithi022 2023-07-13T01:36:08.999 INFO:tasks.cephadm:Adding mgr.b on smithi084 2023-07-13T01:36:08.999 INFO:tasks.cephadm:Adding mgr.c on smithi103 2023-07-13T01:36:08.999 INFO:tasks.cephadm:Adding mgr.d on smithi137 2023-07-13T01:36:08.999 INFO:tasks.cephadm:Adding mgr.e on smithi154 2023-07-13T01:36:09.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch apply mgr '5;smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e' 2023-07-13T01:36:09.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:09 smithi154 bash[27744]: cluster 1689212167.7452517 mgr.a (mgr.14152) 144 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:09.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:09 smithi154 bash[27744]: audit 1689212169.0481036 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:09 smithi154 bash[27744]: audit 1689212169.054304 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:09 smithi137 bash[27262]: cluster 1689212167.7452517 mgr.a (mgr.14152) 144 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:09.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:09 smithi137 bash[27262]: audit 1689212169.0481036 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:09 smithi137 bash[27262]: audit 1689212169.054304 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:09 smithi103 bash[27315]: cluster 1689212167.7452517 mgr.a (mgr.14152) 144 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:09.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:09 smithi103 bash[27315]: audit 1689212169.0481036 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:09 smithi103 bash[27315]: audit 1689212169.054304 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.404 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:09 smithi084 bash[27323]: cluster 1689212167.7452517 mgr.a (mgr.14152) 144 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:09.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:09 smithi084 bash[27323]: audit 1689212169.0481036 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:09 smithi084 bash[27323]: audit 1689212169.054304 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:09 smithi022 bash[26979]: cluster 1689212167.7452517 mgr.a (mgr.14152) 144 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:09.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:09 smithi022 bash[26979]: audit 1689212169.0481036 mon.a (mon.0) 340 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:09.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:09 smithi022 bash[26979]: audit 1689212169.054304 mon.a (mon.0) 341 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:10.330 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:10 smithi154 bash[27744]: cephadm 1689212169.094014 mgr.a (mgr.14152) 145 : cephadm 1 Reconfiguring mon.e (monmap changed)... 2023-07-13T01:36:10.330 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:10 smithi154 bash[27744]: audit 1689212169.0946846 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:10.330 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:10 smithi154 bash[27744]: audit 1689212169.0964997 mon.a (mon.0) 343 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:10.330 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:10 smithi154 bash[27744]: audit 1689212169.0981767 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:10.330 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:10 smithi154 bash[27744]: cephadm 1689212169.1002374 mgr.a (mgr.14152) 146 : cephadm 1 Reconfiguring daemon mon.e on smithi154 2023-07-13T01:36:10.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:10 smithi103 bash[27315]: cephadm 1689212169.094014 mgr.a (mgr.14152) 145 : cephadm 1 Reconfiguring mon.e (monmap changed)... 2023-07-13T01:36:10.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:10 smithi103 bash[27315]: audit 1689212169.0946846 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:10.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:10 smithi103 bash[27315]: audit 1689212169.0964997 mon.a (mon.0) 343 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:10.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:10 smithi103 bash[27315]: audit 1689212169.0981767 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:10.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:10 smithi103 bash[27315]: cephadm 1689212169.1002374 mgr.a (mgr.14152) 146 : cephadm 1 Reconfiguring daemon mon.e on smithi154 2023-07-13T01:36:10.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:10 smithi084 bash[27323]: cephadm 1689212169.094014 mgr.a (mgr.14152) 145 : cephadm 1 Reconfiguring mon.e (monmap changed)... 2023-07-13T01:36:10.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:10 smithi084 bash[27323]: audit 1689212169.0946846 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:10.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:10 smithi084 bash[27323]: audit 1689212169.0964997 mon.a (mon.0) 343 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:10.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:10 smithi084 bash[27323]: audit 1689212169.0981767 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:10.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:10 smithi084 bash[27323]: cephadm 1689212169.1002374 mgr.a (mgr.14152) 146 : cephadm 1 Reconfiguring daemon mon.e on smithi154 2023-07-13T01:36:10.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:10 smithi022 bash[26979]: cephadm 1689212169.094014 mgr.a (mgr.14152) 145 : cephadm 1 Reconfiguring mon.e (monmap changed)... 2023-07-13T01:36:10.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:10 smithi022 bash[26979]: audit 1689212169.0946846 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:10.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:10 smithi022 bash[26979]: audit 1689212169.0964997 mon.a (mon.0) 343 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:10.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:10 smithi022 bash[26979]: audit 1689212169.0981767 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:10.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:10 smithi022 bash[26979]: cephadm 1689212169.1002374 mgr.a (mgr.14152) 146 : cephadm 1 Reconfiguring daemon mon.e on smithi154 2023-07-13T01:36:10.566 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:10 smithi137 bash[27262]: cephadm 1689212169.094014 mgr.a (mgr.14152) 145 : cephadm 1 Reconfiguring mon.e (monmap changed)... 2023-07-13T01:36:10.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:10 smithi137 bash[27262]: audit 1689212169.0946846 mon.a (mon.0) 342 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-13T01:36:10.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:10 smithi137 bash[27262]: audit 1689212169.0964997 mon.a (mon.0) 343 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-13T01:36:10.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:10 smithi137 bash[27262]: audit 1689212169.0981767 mon.a (mon.0) 344 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:10.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:10 smithi137 bash[27262]: cephadm 1689212169.1002374 mgr.a (mgr.14152) 146 : cephadm 1 Reconfiguring daemon mon.e on smithi154 2023-07-13T01:36:11.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:11 smithi103 bash[27315]: cluster 1689212169.7456484 mgr.a (mgr.14152) 147 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:11.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:11 smithi084 bash[27323]: cluster 1689212169.7456484 mgr.a (mgr.14152) 147 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:11.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:11 smithi022 bash[26979]: cluster 1689212169.7456484 mgr.a (mgr.14152) 147 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:11.519 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:11 smithi154 bash[27744]: cluster 1689212169.7456484 mgr.a (mgr.14152) 147 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:11.566 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:11 smithi137 bash[27262]: cluster 1689212169.7456484 mgr.a (mgr.14152) 147 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:12.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:12 smithi103 bash[27315]: audit 1689212171.0853565 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:12 smithi103 bash[27315]: audit 1689212171.0905552 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:12 smithi103 bash[27315]: audit 1689212171.1216767 mon.a (mon.0) 347 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:12.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:12 smithi103 bash[27315]: audit 1689212171.5934546 mon.a (mon.0) 348 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:12.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:12 smithi103 bash[27315]: audit 1689212171.595307 mon.a (mon.0) 349 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:12.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:12 smithi103 bash[27315]: audit 1689212171.6055894 mon.a (mon.0) 350 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:12 smithi084 bash[27323]: audit 1689212171.0853565 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:12 smithi084 bash[27323]: audit 1689212171.0905552 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:12 smithi084 bash[27323]: audit 1689212171.1216767 mon.a (mon.0) 347 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:12.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:12 smithi084 bash[27323]: audit 1689212171.5934546 mon.a (mon.0) 348 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:12.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:12 smithi084 bash[27323]: audit 1689212171.595307 mon.a (mon.0) 349 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:12.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:12 smithi084 bash[27323]: audit 1689212171.6055894 mon.a (mon.0) 350 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:12 smithi022 bash[26979]: audit 1689212171.0853565 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:12 smithi022 bash[26979]: audit 1689212171.0905552 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:12 smithi022 bash[26979]: audit 1689212171.1216767 mon.a (mon.0) 347 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:12.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:12 smithi022 bash[26979]: audit 1689212171.5934546 mon.a (mon.0) 348 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:12.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:12 smithi022 bash[26979]: audit 1689212171.595307 mon.a (mon.0) 349 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:12.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:12 smithi022 bash[26979]: audit 1689212171.6055894 mon.a (mon.0) 350 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.519 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:12 smithi154 bash[27744]: audit 1689212171.0853565 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:12 smithi154 bash[27744]: audit 1689212171.0905552 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:12 smithi154 bash[27744]: audit 1689212171.1216767 mon.a (mon.0) 347 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:12.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:12 smithi154 bash[27744]: audit 1689212171.5934546 mon.a (mon.0) 348 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:12.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:12 smithi154 bash[27744]: audit 1689212171.595307 mon.a (mon.0) 349 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:12.520 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:12 smithi154 bash[27744]: audit 1689212171.6055894 mon.a (mon.0) 350 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:12 smithi137 bash[27262]: audit 1689212171.0853565 mon.a (mon.0) 345 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:12 smithi137 bash[27262]: audit 1689212171.0905552 mon.a (mon.0) 346 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:12 smithi137 bash[27262]: audit 1689212171.1216767 mon.a (mon.0) 347 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:12.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:12 smithi137 bash[27262]: audit 1689212171.5934546 mon.a (mon.0) 348 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:12.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:12 smithi137 bash[27262]: audit 1689212171.595307 mon.a (mon.0) 349 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:12.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:12 smithi137 bash[27262]: audit 1689212171.6055894 mon.a (mon.0) 350 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:12.716 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:36:13.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:13 smithi103 bash[27315]: cluster 1689212171.746143 mgr.a (mgr.14152) 148 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:13.404 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:13 smithi084 bash[27323]: cluster 1689212171.746143 mgr.a (mgr.14152) 148 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:13.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:13 smithi022 bash[26979]: cluster 1689212171.746143 mgr.a (mgr.14152) 148 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:13.519 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:13 smithi154 bash[27744]: cluster 1689212171.746143 mgr.a (mgr.14152) 148 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:13.566 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:13 smithi137 bash[27262]: cluster 1689212171.746143 mgr.a (mgr.14152) 148 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:15.356 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:15 smithi154 bash[27744]: cluster 1689212173.7466085 mgr.a (mgr.14152) 149 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:15.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:15 smithi103 bash[27315]: cluster 1689212173.7466085 mgr.a (mgr.14152) 149 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:15.404 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:15 smithi084 bash[27323]: cluster 1689212173.7466085 mgr.a (mgr.14152) 149 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:15.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:15 smithi022 bash[26979]: cluster 1689212173.7466085 mgr.a (mgr.14152) 149 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:15.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:15 smithi137 bash[27262]: cluster 1689212173.7466085 mgr.a (mgr.14152) 149 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:15.837 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mgr update... 2023-07-13T01:36:16.545 DEBUG:teuthology.orchestra.run.smithi084:mgr.b> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.b.service 2023-07-13T01:36:16.553 DEBUG:teuthology.orchestra.run.smithi103:mgr.c> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.c.service 2023-07-13T01:36:16.557 DEBUG:teuthology.orchestra.run.smithi137:mgr.d> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.d.service 2023-07-13T01:36:16.560 DEBUG:teuthology.orchestra.run.smithi154:mgr.e> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.e.service 2023-07-13T01:36:16.563 INFO:tasks.cephadm:Deploying OSDs... 2023-07-13T01:36:16.563 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-07-13T01:36:16.564 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T01:36:16.572 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T01:36:16.572 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2023-07-13T01:36:16.620 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T01:36:16.620 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:16.620 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-07-13T01:36:16.621 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:16.621 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-13 01:26:46.305332858 +0000 2023-07-13T01:36:16.621 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-13 01:26:45.981340329 +0000 2023-07-13T01:36:16.621 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-13 01:26:45.981340329 +0000 2023-07-13T01:36:16.622 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-07-13T01:36:16.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T01:36:16.676 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-13T01:36:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-13T01:36:16.677 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000343704 s, 1.5 MB/s 2023-07-13T01:36:16.678 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T01:36:16.728 INFO:journalctl@ceph.mgr.c.smithi103.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:36:16.729 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2023-07-13T01:36:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T01:36:16.780 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:16.780 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-07-13T01:36:16.780 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:16.780 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-13 01:26:46.849320312 +0000 2023-07-13T01:36:16.781 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-13 01:26:46.529327691 +0000 2023-07-13T01:36:16.781 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-13 01:26:46.529327691 +0000 2023-07-13T01:36:16.781 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-07-13T01:36:16.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T01:36:16.819 INFO:journalctl@ceph.mgr.e.smithi154.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:36:16.837 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-13T01:36:16.837 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-13T01:36:16.837 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.00033306 s, 1.5 MB/s 2023-07-13T01:36:16.839 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T01:36:16.889 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2023-07-13T01:36:16.917 INFO:journalctl@ceph.mgr.b.smithi084.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:36:16.944 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T01:36:16.945 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:16.945 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-07-13T01:36:16.945 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:16.945 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-13 01:26:47.361308504 +0000 2023-07-13T01:36:16.946 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-13 01:26:47.037315977 +0000 2023-07-13T01:36:16.946 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-13 01:26:47.037315977 +0000 2023-07-13T01:36:16.946 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-07-13T01:36:16.946 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T01:36:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: cluster 1689212175.747045 mgr.a (mgr.14152) 150 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.8222783 mgr.a (mgr.14152) 151 : audit 0 from='client.24111 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "5;smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: cephadm 1689212175.8265853 mgr.a (mgr.14152) 152 : cephadm 1 Saving service mgr spec with placement smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e;count:5 2023-07-13T01:36:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.8339703 mon.a (mon.0) 351 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.845242 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.848987 mon.a (mon.0) 353 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.850665 mon.a (mon.0) 354 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.8583155 mon.a (mon.0) 355 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.86086 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:17.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.8653278 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:17.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.8665392 mon.a (mon.0) 358 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:17.006 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: audit 1689212175.8680782 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.007 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:16 smithi022 bash[26979]: cephadm 1689212175.869618 mgr.a (mgr.14152) 153 : cephadm 1 Deploying daemon mgr.d on smithi137 2023-07-13T01:36:17.007 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-13T01:36:17.008 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-13T01:36:17.008 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000304426 s, 1.7 MB/s 2023-07-13T01:36:17.008 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T01:36:17.057 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2023-07-13T01:36:17.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: cluster 1689212175.747045 mgr.a (mgr.14152) 150 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:17.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.8222783 mgr.a (mgr.14152) 151 : audit 0 from='client.24111 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "5;smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:17.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: cephadm 1689212175.8265853 mgr.a (mgr.14152) 152 : cephadm 1 Saving service mgr spec with placement smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e;count:5 2023-07-13T01:36:17.069 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.8339703 mon.a (mon.0) 351 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.845242 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.848987 mon.a (mon.0) 353 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.850665 mon.a (mon.0) 354 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.8583155 mon.a (mon.0) 355 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.86086 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.8653278 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:17.070 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.8665392 mon.a (mon.0) 358 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:17.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: audit 1689212175.8680782 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.071 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:16 smithi137 bash[27262]: cephadm 1689212175.869618 mgr.a (mgr.14152) 153 : cephadm 1 Deploying daemon mgr.d on smithi137 2023-07-13T01:36:17.114 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T01:36:17.114 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:17.114 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 509 Links: 1 2023-07-13T01:36:17.114 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:17.114 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-07-13 01:26:47.917295682 +0000 2023-07-13T01:36:17.114 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-07-13 01:26:47.581303431 +0000 2023-07-13T01:36:17.115 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-07-13 01:26:47.581303431 +0000 2023-07-13T01:36:17.115 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-07-13T01:36:17.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T01:36:17.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: cluster 1689212175.747045 mgr.a (mgr.14152) 150 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:17.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.8222783 mgr.a (mgr.14152) 151 : audit 0 from='client.24111 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "5;smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:17.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: cephadm 1689212175.8265853 mgr.a (mgr.14152) 152 : cephadm 1 Saving service mgr spec with placement smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e;count:5 2023-07-13T01:36:17.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.8339703 mon.a (mon.0) 351 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.845242 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:17.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.848987 mon.a (mon.0) 353 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.850665 mon.a (mon.0) 354 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:17.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.8583155 mon.a (mon.0) 355 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.86086 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:17.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.8653278 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:17.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.8665392 mon.a (mon.0) 358 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:17.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: audit 1689212175.8680782 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:16 smithi103 bash[27315]: cephadm 1689212175.869618 mgr.a (mgr.14152) 153 : cephadm 1 Deploying daemon mgr.d on smithi137 2023-07-13T01:36:17.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: cluster 1689212175.747045 mgr.a (mgr.14152) 150 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:17.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.8222783 mgr.a (mgr.14152) 151 : audit 0 from='client.24111 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "5;smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:17.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: cephadm 1689212175.8265853 mgr.a (mgr.14152) 152 : cephadm 1 Saving service mgr spec with placement smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e;count:5 2023-07-13T01:36:17.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.8339703 mon.a (mon.0) 351 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.845242 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.848987 mon.a (mon.0) 353 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.850665 mon.a (mon.0) 354 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.8583155 mon.a (mon.0) 355 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.86086 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.8653278 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.8665392 mon.a (mon.0) 358 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:17.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: audit 1689212175.8680782 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:16 smithi084 bash[27323]: cephadm 1689212175.869618 mgr.a (mgr.14152) 153 : cephadm 1 Deploying daemon mgr.d on smithi137 2023-07-13T01:36:17.171 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-07-13T01:36:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-07-13T01:36:17.172 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000343784 s, 1.5 MB/s 2023-07-13T01:36:17.173 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T01:36:17.227 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-07-13T01:36:17.227 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T01:36:17.235 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T01:36:17.236 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-07-13T01:36:17.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: cluster 1689212175.747045 mgr.a (mgr.14152) 150 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:17.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.8222783 mgr.a (mgr.14152) 151 : audit 0 from='client.24111 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "5;smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:17.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: cephadm 1689212175.8265853 mgr.a (mgr.14152) 152 : cephadm 1 Saving service mgr spec with placement smithi022=a;smithi084=b;smithi103=c;smithi137=d;smithi154=e;count:5 2023-07-13T01:36:17.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.8339703 mon.a (mon.0) 351 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.845242 mon.a (mon.0) 352 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:17.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.848987 mon.a (mon.0) 353 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.850665 mon.a (mon.0) 354 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:17.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.8583155 mon.a (mon.0) 355 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:17.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.86086 mon.a (mon.0) 356 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:17.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.8653278 mon.a (mon.0) 357 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.d", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:17.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.8665392 mon.a (mon.0) 358 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:17.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: audit 1689212175.8680782 mon.a (mon.0) 359 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:17.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:16 smithi154 bash[27744]: cephadm 1689212175.869618 mgr.a (mgr.14152) 153 : cephadm 1 Deploying daemon mgr.d on smithi137 2023-07-13T01:36:17.283 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T01:36:17.284 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:17.285 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 494 Links: 1 2023-07-13T01:36:17.285 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:17.285 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-13 01:26:54.132920774 +0000 2023-07-13T01:36:17.285 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-13 01:26:53.720930270 +0000 2023-07-13T01:36:17.286 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-13 01:26:53.720930270 +0000 2023-07-13T01:36:17.286 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-07-13T01:36:17.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T01:36:17.337 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-13T01:36:17.337 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-13T01:36:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000399487 s, 1.3 MB/s 2023-07-13T01:36:17.339 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T01:36:17.389 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-07-13T01:36:17.431 INFO:journalctl@ceph.mgr.d.smithi137.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:36:17.439 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T01:36:17.440 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:17.440 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-07-13T01:36:17.440 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:17.441 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-13 01:26:54.712907406 +0000 2023-07-13T01:36:17.441 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-13 01:26:54.352915703 +0000 2023-07-13T01:36:17.441 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-13 01:26:54.352915703 +0000 2023-07-13T01:36:17.441 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-07-13T01:36:17.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T01:36:17.493 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-13T01:36:17.494 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-13T01:36:17.494 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000391575 s, 1.3 MB/s 2023-07-13T01:36:17.495 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T01:36:17.545 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-07-13T01:36:17.595 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T01:36:17.596 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:17.596 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-07-13T01:36:17.596 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:17.596 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-13 01:26:55.300893851 +0000 2023-07-13T01:36:17.596 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-13 01:26:54.940902150 +0000 2023-07-13T01:36:17.597 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-13 01:26:54.940902150 +0000 2023-07-13T01:36:17.597 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-07-13T01:36:17.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T01:36:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-13T01:36:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-13T01:36:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000405064 s, 1.3 MB/s 2023-07-13T01:36:17.653 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T01:36:17.706 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-07-13T01:36:17.756 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T01:36:17.756 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:17.756 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-07-13T01:36:17.757 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:17.757 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-07-13 01:26:55.856881037 +0000 2023-07-13T01:36:17.757 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-07-13 01:26:55.504889149 +0000 2023-07-13T01:36:17.757 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-07-13 01:26:55.504889149 +0000 2023-07-13T01:36:17.758 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-07-13T01:36:17.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T01:36:17.815 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-07-13T01:36:17.816 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-07-13T01:36:17.816 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000409727 s, 1.2 MB/s 2023-07-13T01:36:17.817 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T01:36:17.869 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-13T01:36:17.870 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T01:36:17.878 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T01:36:17.878 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2023-07-13T01:36:17.928 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T01:36:17.928 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 491 Links: 1 2023-07-13T01:36:17.928 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-13 01:26:47.337695751 +0000 2023-07-13T01:36:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-13 01:26:47.333695844 +0000 2023-07-13T01:36:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-13 01:26:47.333695844 +0000 2023-07-13T01:36:17.929 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-13T01:36:17.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T01:36:17.983 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-13T01:36:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-13T01:36:17.984 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000412573 s, 1.2 MB/s 2023-07-13T01:36:17.985 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T01:36:18.041 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2023-07-13T01:36:18.093 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-13 01:26:48.261674443 +0000 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-13 01:26:47.921682284 +0000 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-13 01:26:47.921682284 +0000 2023-07-13T01:36:18.094 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-13T01:36:18.095 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T01:36:18.153 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-13T01:36:18.153 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-13T01:36:18.153 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000389839 s, 1.3 MB/s 2023-07-13T01:36:18.153 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T01:36:18.206 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2023-07-13T01:36:18.256 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T01:36:18.256 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-07-13T01:36:18.256 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-13 01:26:48.489669185 +0000 2023-07-13T01:36:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-13 01:26:48.485669278 +0000 2023-07-13T01:36:18.257 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-13 01:26:48.485669278 +0000 2023-07-13T01:36:18.257 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-13T01:36:18.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T01:36:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-13T01:36:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-13T01:36:18.310 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000405525 s, 1.3 MB/s 2023-07-13T01:36:18.311 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T01:36:18.361 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2023-07-13T01:36:18.412 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T01:36:18.412 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-07-13T01:36:18.412 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-13 01:26:49.385648523 +0000 2023-07-13T01:36:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-13 01:26:49.061655994 +0000 2023-07-13T01:36:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-13 01:26:49.061655994 +0000 2023-07-13T01:36:18.413 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-13T01:36:18.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T01:36:18.467 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-13T01:36:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-13T01:36:18.468 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000420844 s, 1.2 MB/s 2023-07-13T01:36:18.469 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T01:36:18.522 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2023-07-13T01:36:18.523 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T01:36:18.540 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T01:36:18.540 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2023-07-13T01:36:18.594 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T01:36:18.595 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 489 Links: 1 2023-07-13T01:36:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-07-13 01:26:57.897154275 +0000 2023-07-13T01:36:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-07-13 01:26:57.565161930 +0000 2023-07-13T01:36:18.595 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-07-13 01:26:57.565161930 +0000 2023-07-13T01:36:18.596 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2023-07-13T01:36:18.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T01:36:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-07-13T01:36:18.653 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-07-13T01:36:18.654 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000328777 s, 1.6 MB/s 2023-07-13T01:36:18.655 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T01:36:18.713 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2023-07-13T01:36:18.761 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T01:36:18.762 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:18.762 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-07-13T01:36:18.762 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:18.762 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-07-13 01:26:58.437141821 +0000 2023-07-13T01:36:18.762 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-07-13 01:26:58.109149386 +0000 2023-07-13T01:36:18.762 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-07-13 01:26:58.109149386 +0000 2023-07-13T01:36:18.763 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2023-07-13T01:36:18.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T01:36:18.812 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-07-13T01:36:18.812 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-07-13T01:36:18.812 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000401623 s, 1.3 MB/s 2023-07-13T01:36:18.813 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T01:36:18.863 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2023-07-13T01:36:18.914 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T01:36:18.914 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:18.915 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-07-13T01:36:18.915 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:18.915 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-07-13 01:26:58.653136839 +0000 2023-07-13T01:36:18.915 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-07-13 01:26:58.649136933 +0000 2023-07-13T01:36:18.916 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-07-13 01:26:58.649136933 +0000 2023-07-13T01:36:18.916 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2023-07-13T01:36:18.916 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T01:36:18.967 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: cluster 1689212177.7474232 mgr.a (mgr.14152) 154 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:18.968 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.719777 mon.a (mon.0) 360 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:18.968 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.7264066 mon.a (mon.0) 361 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:18.968 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.7483256 mon.a (mon.0) 362 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:18.969 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.7494967 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:18.969 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.7535949 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:18.969 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.7547724 mon.a (mon.0) 365 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:18.969 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:18 smithi137 bash[27262]: audit 1689212178.7559578 mon.a (mon.0) 366 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:18.970 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-07-13T01:36:18.970 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-07-13T01:36:18.970 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000287497 s, 1.8 MB/s 2023-07-13T01:36:18.971 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T01:36:19.020 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2023-07-13T01:36:19.070 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T01:36:19.070 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:19.071 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-07-13T01:36:19.071 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:19.071 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2023-07-13 01:26:59.581115440 +0000 2023-07-13T01:36:19.071 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2023-07-13 01:26:59.185124571 +0000 2023-07-13T01:36:19.071 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2023-07-13 01:26:59.185124571 +0000 2023-07-13T01:36:19.071 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: - 2023-07-13T01:36:19.072 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T01:36:19.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: cluster 1689212177.7474232 mgr.a (mgr.14152) 154 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:19.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.719777 mon.a (mon.0) 360 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.7264066 mon.a (mon.0) 361 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.7483256 mon.a (mon.0) 362 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.7494967 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:19.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.7535949 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:19.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.7547724 mon.a (mon.0) 365 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:19.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:18 smithi103 bash[27315]: audit 1689212178.7559578 mon.a (mon.0) 366 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:19.122 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: cluster 1689212177.7474232 mgr.a (mgr.14152) 154 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:19.122 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.719777 mon.a (mon.0) 360 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.122 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.7264066 mon.a (mon.0) 361 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.122 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.7483256 mon.a (mon.0) 362 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.122 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.7494967 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:19.123 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.7535949 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:19.123 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.7547724 mon.a (mon.0) 365 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:19.123 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:18 smithi154 bash[27744]: audit 1689212178.7559578 mon.a (mon.0) 366 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:19.123 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2023-07-13T01:36:19.123 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2023-07-13T01:36:19.124 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000367863 s, 1.4 MB/s 2023-07-13T01:36:19.125 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T01:36:19.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: cluster 1689212177.7474232 mgr.a (mgr.14152) 154 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:19.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.719777 mon.a (mon.0) 360 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.7264066 mon.a (mon.0) 361 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.7483256 mon.a (mon.0) 362 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.7494967 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:19.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.7535949 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:19.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.7547724 mon.a (mon.0) 365 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:19.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:18 smithi084 bash[27323]: audit 1689212178.7559578 mon.a (mon.0) 366 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:19.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: cluster 1689212177.7474232 mgr.a (mgr.14152) 154 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:19.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.719777 mon.a (mon.0) 360 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.7264066 mon.a (mon.0) 361 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.7483256 mon.a (mon.0) 362 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:19.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.7494967 mon.a (mon.0) 363 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:19.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.7535949 mon.a (mon.0) 364 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.e", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:19.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.7547724 mon.a (mon.0) 365 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:19.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:18 smithi022 bash[26979]: audit 1689212178.7559578 mon.a (mon.0) 366 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:19.176 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-07-13T01:36:19.176 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-07-13T01:36:19.186 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-13T01:36:19.186 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-07-13T01:36:19.236 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-13T01:36:19.236 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 493 Links: 1 2023-07-13T01:36:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-13 01:26:56.530231451 +0000 2023-07-13T01:36:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-13 01:26:56.086241690 +0000 2023-07-13T01:36:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-13 01:26:56.086241690 +0000 2023-07-13T01:36:19.238 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-07-13T01:36:19.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-13T01:36:19.294 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-13T01:36:19.294 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-13T01:36:19.294 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000398321 s, 1.3 MB/s 2023-07-13T01:36:19.296 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-13T01:36:19.345 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-07-13T01:36:19.395 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-13T01:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-07-13T01:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:19.396 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-13 01:26:57.066219090 +0000 2023-07-13T01:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-13 01:26:56.754226285 +0000 2023-07-13T01:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-13 01:26:56.754226285 +0000 2023-07-13T01:36:19.397 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-07-13T01:36:19.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-13T01:36:19.453 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-13T01:36:19.454 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-13T01:36:19.454 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000414187 s, 1.2 MB/s 2023-07-13T01:36:19.455 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-13T01:36:19.505 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-07-13T01:36:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-13T01:36:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:19.553 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-07-13T01:36:19.553 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:19.553 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-13 01:26:57.646205715 +0000 2023-07-13T01:36:19.553 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-13 01:26:57.294213832 +0000 2023-07-13T01:36:19.554 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-13 01:26:57.294213832 +0000 2023-07-13T01:36:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-07-13T01:36:19.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-13T01:36:19.609 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-13T01:36:19.610 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-13T01:36:19.610 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000409897 s, 1.2 MB/s 2023-07-13T01:36:19.611 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-13T01:36:19.665 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-07-13T01:36:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-13T01:36:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-13T01:36:19.716 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-07-13T01:36:19.716 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-13T01:36:19.716 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-07-13 01:26:58.210192708 +0000 2023-07-13T01:36:19.716 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-07-13 01:26:57.882200273 +0000 2023-07-13T01:36:19.717 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-07-13 01:26:57.882200273 +0000 2023-07-13T01:36:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2023-07-13T01:36:19.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-13T01:36:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-07-13T01:36:19.769 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-07-13T01:36:19.770 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000416946 s, 1.2 MB/s 2023-07-13T01:36:19.770 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-13T01:36:19.825 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2023-07-13T01:36:19.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-13T01:36:20.013 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:19 smithi137 bash[27262]: cephadm 1689212178.7583606 mgr.a (mgr.14152) 155 : cephadm 1 Deploying daemon mgr.e on smithi154 2023-07-13T01:36:20.014 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:19 smithi137 bash[27792]: debug 2023-07-13T01:36:19.846+0000 7f6a5f92e700 1 -- 172.21.15.137:0/3627326943 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b687729520 con 0x55b6884a8800 2023-07-13T01:36:20.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:19 smithi154 bash[27744]: cephadm 1689212178.7583606 mgr.a (mgr.14152) 155 : cephadm 1 Deploying daemon mgr.e on smithi154 2023-07-13T01:36:20.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:19 smithi103 bash[27315]: cephadm 1689212178.7583606 mgr.a (mgr.14152) 155 : cephadm 1 Deploying daemon mgr.e on smithi154 2023-07-13T01:36:20.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:19 smithi084 bash[27323]: cephadm 1689212178.7583606 mgr.a (mgr.14152) 155 : cephadm 1 Deploying daemon mgr.e on smithi154 2023-07-13T01:36:20.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:19 smithi022 bash[26979]: cephadm 1689212178.7583606 mgr.a (mgr.14152) 155 : cephadm 1 Deploying daemon mgr.e on smithi154 2023-07-13T01:36:20.316 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:20 smithi137 bash[27792]: debug 2023-07-13T01:36:20.006+0000 7f6a69a7b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:36:21.097 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:20 smithi154 bash[27744]: cluster 1689212179.7478278 mgr.a (mgr.14152) 156 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:21.112 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:20 smithi137 bash[27262]: cluster 1689212179.7478278 mgr.a (mgr.14152) 156 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:21.112 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:20 smithi137 bash[27792]: debug 2023-07-13T01:36:20.906+0000 7f6a69a7b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:36:21.112 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:21 smithi137 bash[27792]: debug 2023-07-13T01:36:21.002+0000 7f6a69a7b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:36:21.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:20 smithi103 bash[27315]: cluster 1689212179.7478278 mgr.a (mgr.14152) 156 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:21.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:20 smithi084 bash[27323]: cluster 1689212179.7478278 mgr.a (mgr.14152) 156 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:21.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:20 smithi022 bash[26979]: cluster 1689212179.7478278 mgr.a (mgr.14152) 156 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:21.393 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:21 smithi154 systemd[1]: Started Ceph mgr.e for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:36:21.728 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:21 smithi137 bash[27792]: debug 2023-07-13T01:36:21.102+0000 7f6a69a7b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:36:21.728 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:21 smithi137 bash[27792]: debug 2023-07-13T01:36:21.362+0000 7f6a69a7b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:22.066 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:21 smithi137 bash[27792]: debug 2023-07-13T01:36:21.718+0000 7f6a69a7b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:36:22.067 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:21 smithi137 bash[27792]: debug 2023-07-13T01:36:21.882+0000 7f6a69a7b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:22.519 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[28744]: debug 2023-07-13T01:36:22.411+0000 7fae19bb1700 1 -- 172.21.15.154:0/3088202711 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 621+0+0 (secure 0 0 0) 0x5600ba21d1e0 con 0x5600baf88c00 2023-07-13T01:36:22.520 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[28744]: debug 2023-07-13T01:36:22.411+0000 7fae19bb1700 1 -- 172.21.15.154:0/3088202711 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5600ba209520 con 0x5600baf88c00 2023-07-13T01:36:22.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.3470705 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.3527887 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.523 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.3838801 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.384992 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:22.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.3893578 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:22.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.3908615 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:22.524 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: audit 1689212181.3923526 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:22.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: cephadm 1689212181.3940609 mgr.a (mgr.14152) 157 : cephadm 1 Deploying daemon mgr.b on smithi084 2023-07-13T01:36:22.525 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[27744]: cluster 1689212181.7483723 mgr.a (mgr.14152) 158 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:22.566 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27792]: debug 2023-07-13T01:36:22.094+0000 7f6a69a7b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:36:22.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.3470705 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.3527887 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.3838801 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.384992 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:22.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.3893578 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:22.567 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.3908615 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:22.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: audit 1689212181.3923526 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:22.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: cephadm 1689212181.3940609 mgr.a (mgr.14152) 157 : cephadm 1 Deploying daemon mgr.b on smithi084 2023-07-13T01:36:22.568 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:22 smithi137 bash[27262]: cluster 1689212181.7483723 mgr.a (mgr.14152) 158 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:22.615 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.3470705 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.3527887 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.3838801 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.384992 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:22.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.3893578 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:22.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.3908615 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:22.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: audit 1689212181.3923526 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:22.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: cephadm 1689212181.3940609 mgr.a (mgr.14152) 157 : cephadm 1 Deploying daemon mgr.b on smithi084 2023-07-13T01:36:22.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:22 smithi103 bash[27315]: cluster 1689212181.7483723 mgr.a (mgr.14152) 158 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:22.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.3470705 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.3527887 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.3838801 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.384992 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:22.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.3893578 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:22.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.3908615 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:22.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: audit 1689212181.3923526 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:22.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: cephadm 1689212181.3940609 mgr.a (mgr.14152) 157 : cephadm 1 Deploying daemon mgr.b on smithi084 2023-07-13T01:36:22.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:22 smithi084 bash[27323]: cluster 1689212181.7483723 mgr.a (mgr.14152) 158 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:22.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.3470705 mon.a (mon.0) 367 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.3527887 mon.a (mon.0) 368 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.3838801 mon.a (mon.0) 369 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.384992 mon.a (mon.0) 370 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.3893578 mon.a (mon.0) 371 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.b", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:22.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.3908615 mon.a (mon.0) 372 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:22.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: audit 1689212181.3923526 mon.a (mon.0) 373 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:22.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: cephadm 1689212181.3940609 mgr.a (mgr.14152) 157 : cephadm 1 Deploying daemon mgr.b on smithi084 2023-07-13T01:36:22.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:22 smithi022 bash[26979]: cluster 1689212181.7483723 mgr.a (mgr.14152) 158 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:22.861 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:22 smithi154 bash[28744]: debug 2023-07-13T01:36:22.571+0000 7fae23cfe200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:36:23.566 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:23 smithi137 bash[27792]: debug 2023-07-13T01:36:23.102+0000 7f6a69a7b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:36:23.566 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:23 smithi137 bash[27792]: debug 2023-07-13T01:36:23.214+0000 7f6a69a7b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:36:23.567 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:23 smithi137 bash[27792]: debug 2023-07-13T01:36:23.330+0000 7f6a69a7b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:36:23.769 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:23 smithi154 bash[28744]: debug 2023-07-13T01:36:23.511+0000 7fae23cfe200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:36:23.769 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:23 smithi154 bash[28744]: debug 2023-07-13T01:36:23.619+0000 7fae23cfe200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:36:23.769 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:23 smithi154 bash[28744]: debug 2023-07-13T01:36:23.727+0000 7fae23cfe200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:36:24.066 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:23 smithi137 bash[27792]: debug 2023-07-13T01:36:23.798+0000 7f6a69a7b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:36:24.066 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27792]: debug 2023-07-13T01:36:24.018+0000 7f6a69a7b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:36:24.154 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:23 smithi084 systemd[1]: Started Ceph mgr.b for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:36:24.269 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:23 smithi154 bash[28744]: debug 2023-07-13T01:36:23.991+0000 7fae23cfe200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:24.525 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:36:24.725 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[28744]: debug 2023-07-13T01:36:24.347+0000 7fae23cfe200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:36:24.725 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[28744]: debug 2023-07-13T01:36:24.507+0000 7fae23cfe200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:24.816 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27792]: debug 2023-07-13T01:36:24.386+0000 7f6a69a7b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:36:25.019 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[28744]: debug 2023-07-13T01:36:24.723+0000 7fae23cfe200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:36:25.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: cluster 1689212183.748842 mgr.a (mgr.14152) 159 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9291575 mon.a (mon.0) 374 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9354503 mon.a (mon.0) 375 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9722326 mon.a (mon.0) 376 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9735568 mon.a (mon.0) 377 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9781191 mon.a (mon.0) 378 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9793859 mon.a (mon.0) 379 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:25.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: audit 1689212183.9805899 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:25.021 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:24 smithi154 bash[27744]: cephadm 1689212183.9820204 mgr.a (mgr.14152) 160 : cephadm 1 Deploying daemon mgr.c on smithi103 2023-07-13T01:36:25.140 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27868]: debug 2023-07-13T01:36:24.977+0000 7f4dc4743700 1 -- 172.21.15.84:0/3300671297 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564354f91520 con 0x564355d10800 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: cluster 1689212183.748842 mgr.a (mgr.14152) 159 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9291575 mon.a (mon.0) 374 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9354503 mon.a (mon.0) 375 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9722326 mon.a (mon.0) 376 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9735568 mon.a (mon.0) 377 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9781191 mon.a (mon.0) 378 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:25.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9793859 mon.a (mon.0) 379 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:25.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: audit 1689212183.9805899 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:25.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:24 smithi084 bash[27323]: cephadm 1689212183.9820204 mgr.a (mgr.14152) 160 : cephadm 1 Deploying daemon mgr.c on smithi103 2023-07-13T01:36:25.234 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: cluster 1689212183.748842 mgr.a (mgr.14152) 159 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9291575 mon.a (mon.0) 374 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9354503 mon.a (mon.0) 375 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9722326 mon.a (mon.0) 376 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9735568 mon.a (mon.0) 377 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9781191 mon.a (mon.0) 378 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9793859 mon.a (mon.0) 379 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:25.235 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: audit 1689212183.9805899 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:25.236 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:24 smithi103 bash[27315]: cephadm 1689212183.9820204 mgr.a (mgr.14152) 160 : cephadm 1 Deploying daemon mgr.c on smithi103 2023-07-13T01:36:25.316 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27792]: debug 2023-07-13T01:36:24.878+0000 7f6a69a7b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:25.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: cluster 1689212183.748842 mgr.a (mgr.14152) 159 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:25.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9291575 mon.a (mon.0) 374 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9354503 mon.a (mon.0) 375 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9722326 mon.a (mon.0) 376 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9735568 mon.a (mon.0) 377 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:25.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9781191 mon.a (mon.0) 378 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:25.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9793859 mon.a (mon.0) 379 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:25.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: audit 1689212183.9805899 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:25.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:24 smithi137 bash[27262]: cephadm 1689212183.9820204 mgr.a (mgr.14152) 160 : cephadm 1 Deploying daemon mgr.c on smithi103 2023-07-13T01:36:25.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: cluster 1689212183.748842 mgr.a (mgr.14152) 159 : cluster 0 pgmap v86: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:25.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9291575 mon.a (mon.0) 374 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9354503 mon.a (mon.0) 375 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9722326 mon.a (mon.0) 376 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:25.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9735568 mon.a (mon.0) 377 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:25.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9781191 mon.a (mon.0) 378 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.c", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-13T01:36:25.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9793859 mon.a (mon.0) 379 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:25.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: audit 1689212183.9805899 mon.a (mon.0) 380 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:25.420 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:24 smithi022 bash[26979]: cephadm 1689212183.9820204 mgr.a (mgr.14152) 160 : cephadm 1 Deploying daemon mgr.c on smithi103 2023-07-13T01:36:25.816 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:25 smithi137 bash[27792]: debug 2023-07-13T01:36:25.470+0000 7f6a69a7b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:36:25.816 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:25 smithi137 bash[27792]: debug 2023-07-13T01:36:25.582+0000 7f6a69a7b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:36:26.020 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:25 smithi154 bash[28744]: debug 2023-07-13T01:36:25.723+0000 7fae23cfe200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:36:26.020 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:25 smithi154 bash[28744]: debug 2023-07-13T01:36:25.835+0000 7fae23cfe200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:36:26.021 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:25 smithi154 bash[28744]: debug 2023-07-13T01:36:25.955+0000 7fae23cfe200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:36:26.188 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:25 smithi137 bash[27792]: debug 2023-07-13T01:36:25.930+0000 7f6a69a7b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:36:26.188 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27792]: debug 2023-07-13T01:36:26.042+0000 7f6a69a7b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:36:26.404 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:25 smithi084 bash[27868]: debug 2023-07-13T01:36:25.133+0000 7f4dce890200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:36:26.405 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27868]: debug 2023-07-13T01:36:26.049+0000 7f4dce890200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:36:26.405 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27868]: debug 2023-07-13T01:36:26.149+0000 7f4dce890200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:36:26.405 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27868]: debug 2023-07-13T01:36:26.253+0000 7f4dce890200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:36:26.566 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27792]: debug 2023-07-13T01:36:26.182+0000 7f6a69a7b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:26.566 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27792]: debug 2023-07-13T01:36:26.290+0000 7f6a69a7b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:36:26.566 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27792]: debug 2023-07-13T01:36:26.414+0000 7f6a69a7b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:36:26.769 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[28744]: debug 2023-07-13T01:36:26.423+0000 7fae23cfe200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:36:26.769 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[28744]: debug 2023-07-13T01:36:26.647+0000 7fae23cfe200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:36:26.876 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27868]: debug 2023-07-13T01:36:26.513+0000 7f4dce890200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:26.935 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27792]: debug 2023-07-13T01:36:26.598+0000 7f6a69a7b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:36:26.936 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27792]: debug 2023-07-13T01:36:26.722+0000 7f6a69a7b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:36:27.154 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27868]: debug 2023-07-13T01:36:26.869+0000 7f4dce890200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:36:27.155 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:27 smithi084 bash[27868]: debug 2023-07-13T01:36:27.037+0000 7f4dce890200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:27.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27323]: cluster 1689212185.749272 mgr.a (mgr.14152) 161 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:27.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27323]: audit 1689212186.562499 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27323]: audit 1689212186.5674405 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27323]: audit 1689212186.6092424 mon.a (mon.0) 383 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27323]: audit 1689212186.6152225 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:26 smithi084 bash[27323]: audit 1689212186.7785149 mon.a (mon.0) 385 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:27.269 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:27 smithi154 bash[28744]: debug 2023-07-13T01:36:27.027+0000 7fae23cfe200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:36:27.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[27744]: cluster 1689212185.749272 mgr.a (mgr.14152) 161 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:27.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[27744]: audit 1689212186.562499 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[27744]: audit 1689212186.5674405 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[27744]: audit 1689212186.6092424 mon.a (mon.0) 383 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[27744]: audit 1689212186.6152225 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:26 smithi154 bash[27744]: audit 1689212186.7785149 mon.a (mon.0) 385 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:27.287 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:26 smithi022 bash[26979]: cluster 1689212185.749272 mgr.a (mgr.14152) 161 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:27.288 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:26 smithi022 bash[26979]: audit 1689212186.562499 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.288 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:26 smithi022 bash[26979]: audit 1689212186.5674405 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.288 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:26 smithi022 bash[26979]: audit 1689212186.6092424 mon.a (mon.0) 383 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.289 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:26 smithi022 bash[26979]: audit 1689212186.6152225 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.289 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:26 smithi022 bash[26979]: audit 1689212186.7785149 mon.a (mon.0) 385 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:27.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27262]: cluster 1689212185.749272 mgr.a (mgr.14152) 161 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:27.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27262]: audit 1689212186.562499 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27262]: audit 1689212186.5674405 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27262]: audit 1689212186.6092424 mon.a (mon.0) 383 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27262]: audit 1689212186.6152225 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:26 smithi137 bash[27262]: audit 1689212186.7785149 mon.a (mon.0) 385 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:27.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:26 smithi103 bash[27315]: cluster 1689212185.749272 mgr.a (mgr.14152) 161 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:27.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:26 smithi103 bash[27315]: audit 1689212186.562499 mon.a (mon.0) 381 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:26 smithi103 bash[27315]: audit 1689212186.5674405 mon.a (mon.0) 382 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:26 smithi103 bash[27315]: audit 1689212186.6092424 mon.a (mon.0) 383 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:26 smithi103 bash[27315]: audit 1689212186.6152225 mon.a (mon.0) 384 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:27.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:26 smithi103 bash[27315]: audit 1689212186.7785149 mon.a (mon.0) 385 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:27.654 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:27 smithi084 bash[27868]: debug 2023-07-13T01:36:27.249+0000 7f4dce890200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:36:27.865 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:27 smithi103 bash[27858]: debug 2023-07-13T01:36:27.721+0000 7f19dcffd700 1 -- 172.21.15.103:0/508332589 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fada8fb520 con 0x55fadb67a800 2023-07-13T01:36:28.009 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-13T01:36:28.009 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-13T01:36:28.009 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2023-07-13T01:36:28.009 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2023-07-13T01:36:28.010 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128819 s, 814 MB/s 2023-07-13T01:36:28.010 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2023-07-13T01:36:28.019 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:27 smithi154 bash[28744]: debug 2023-07-13T01:36:27.523+0000 7fae23cfe200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:28.316 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 01:36:27 smithi137 bash[27792]: debug 2023-07-13T01:36:27.934+0000 7f6a69a7b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:36:28.365 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:27 smithi103 bash[27858]: debug 2023-07-13T01:36:27.881+0000 7f19e714a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-13T01:36:28.519 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[28744]: debug 2023-07-13T01:36:28.087+0000 7fae23cfe200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:36:28.519 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[28744]: debug 2023-07-13T01:36:28.199+0000 7fae23cfe200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:36:28.654 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27868]: debug 2023-07-13T01:36:28.241+0000 7f4dce890200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:36:28.655 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27868]: debug 2023-07-13T01:36:28.353+0000 7f4dce890200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:36:28.655 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27868]: debug 2023-07-13T01:36:28.469+0000 7f4dce890200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:36:28.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2023-07-13T01:36:28.797 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[28744]: debug 2023-07-13T01:36:28.543+0000 7fae23cfe200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:36:28.798 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[28744]: debug 2023-07-13T01:36:28.655+0000 7fae23cfe200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:36:29.115 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27858]: debug 2023-07-13T01:36:28.805+0000 7f19e714a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-13T01:36:29.115 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27858]: debug 2023-07-13T01:36:28.905+0000 7f19e714a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-13T01:36:29.115 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27858]: debug 2023-07-13T01:36:29.005+0000 7f19e714a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-13T01:36:29.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27315]: cluster 1689212187.749666 mgr.a (mgr.14152) 162 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:29.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27315]: cluster 1689212187.9616213 mon.a (mon.0) 386 : cluster 0 Standby manager daemon d started 2023-07-13T01:36:29.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27315]: audit 1689212187.965677 mon.e (mon.1) 6 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/crt"}]: dispatch 2023-07-13T01:36:29.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27315]: audit 1689212187.9663706 mon.e (mon.1) 7 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:29.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27315]: audit 1689212187.9684148 mon.e (mon.1) 8 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/key"}]: dispatch 2023-07-13T01:36:29.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:28 smithi103 bash[27315]: audit 1689212187.9690928 mon.e (mon.1) 9 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:29.225 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[28744]: debug 2023-07-13T01:36:28.795+0000 7fae23cfe200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:29.225 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[28744]: debug 2023-07-13T01:36:28.911+0000 7fae23cfe200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:36:29.225 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:29 smithi154 bash[28744]: debug 2023-07-13T01:36:29.035+0000 7fae23cfe200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:36:29.226 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[27744]: cluster 1689212187.749666 mgr.a (mgr.14152) 162 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:29.226 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[27744]: cluster 1689212187.9616213 mon.a (mon.0) 386 : cluster 0 Standby manager daemon d started 2023-07-13T01:36:29.226 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[27744]: audit 1689212187.965677 mon.e (mon.1) 6 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/crt"}]: dispatch 2023-07-13T01:36:29.226 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[27744]: audit 1689212187.9663706 mon.e (mon.1) 7 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:29.226 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[27744]: audit 1689212187.9684148 mon.e (mon.1) 8 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/key"}]: dispatch 2023-07-13T01:36:29.226 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:28 smithi154 bash[27744]: audit 1689212187.9690928 mon.e (mon.1) 9 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:29.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:28 smithi137 bash[27262]: cluster 1689212187.749666 mgr.a (mgr.14152) 162 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:29.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:28 smithi137 bash[27262]: cluster 1689212187.9616213 mon.a (mon.0) 386 : cluster 0 Standby manager daemon d started 2023-07-13T01:36:29.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:28 smithi137 bash[27262]: audit 1689212187.965677 mon.e (mon.1) 6 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/crt"}]: dispatch 2023-07-13T01:36:29.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:28 smithi137 bash[27262]: audit 1689212187.9663706 mon.e (mon.1) 7 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:29.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:28 smithi137 bash[27262]: audit 1689212187.9684148 mon.e (mon.1) 8 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/key"}]: dispatch 2023-07-13T01:36:29.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:28 smithi137 bash[27262]: audit 1689212187.9690928 mon.e (mon.1) 9 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:29.404 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27868]: debug 2023-07-13T01:36:28.937+0000 7f4dce890200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:36:29.405 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:29 smithi084 bash[27868]: debug 2023-07-13T01:36:29.161+0000 7f4dce890200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:36:29.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27323]: cluster 1689212187.749666 mgr.a (mgr.14152) 162 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:29.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27323]: cluster 1689212187.9616213 mon.a (mon.0) 386 : cluster 0 Standby manager daemon d started 2023-07-13T01:36:29.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27323]: audit 1689212187.965677 mon.e (mon.1) 6 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/crt"}]: dispatch 2023-07-13T01:36:29.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27323]: audit 1689212187.9663706 mon.e (mon.1) 7 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:29.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27323]: audit 1689212187.9684148 mon.e (mon.1) 8 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/key"}]: dispatch 2023-07-13T01:36:29.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:28 smithi084 bash[27323]: audit 1689212187.9690928 mon.e (mon.1) 9 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:29.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:28 smithi022 bash[26979]: cluster 1689212187.749666 mgr.a (mgr.14152) 162 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:28 smithi022 bash[26979]: cluster 1689212187.9616213 mon.a (mon.0) 386 : cluster 0 Standby manager daemon d started 2023-07-13T01:36:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:28 smithi022 bash[26979]: audit 1689212187.965677 mon.e (mon.1) 6 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/crt"}]: dispatch 2023-07-13T01:36:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:28 smithi022 bash[26979]: audit 1689212187.9663706 mon.e (mon.1) 7 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:28 smithi022 bash[26979]: audit 1689212187.9684148 mon.e (mon.1) 8 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/d/key"}]: dispatch 2023-07-13T01:36:29.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:28 smithi022 bash[26979]: audit 1689212187.9690928 mon.e (mon.1) 9 : audit 0 from='mgr.? 172.21.15.137:0/2588628244' entity='mgr.d' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:29.519 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:29 smithi154 bash[28744]: debug 2023-07-13T01:36:29.219+0000 7fae23cfe200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:36:29.519 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:29 smithi154 bash[28744]: debug 2023-07-13T01:36:29.343+0000 7fae23cfe200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:36:29.615 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27858]: debug 2023-07-13T01:36:29.269+0000 7f19e714a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:29.905 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:29 smithi084 bash[27868]: debug 2023-07-13T01:36:29.529+0000 7f4dce890200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:36:29.949 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27858]: debug 2023-07-13T01:36:29.621+0000 7f19e714a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-13T01:36:29.949 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27858]: debug 2023-07-13T01:36:29.785+0000 7f19e714a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:30.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:29 smithi154 bash[27744]: cluster 1689212188.9504614 mon.a (mon.0) 387 : cluster 0 mgrmap e14: a(active, since 3m), standbys: d 2023-07-13T01:36:30.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:29 smithi154 bash[27744]: audit 1689212188.950666 mon.a (mon.0) 388 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "d", "id": "d"}]: dispatch 2023-07-13T01:36:30.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:29 smithi154 bash[27744]: audit 1689212189.0714612 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:30.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:29 smithi137 bash[27262]: cluster 1689212188.9504614 mon.a (mon.0) 387 : cluster 0 mgrmap e14: a(active, since 3m), standbys: d 2023-07-13T01:36:30.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:29 smithi137 bash[27262]: audit 1689212188.950666 mon.a (mon.0) 388 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "d", "id": "d"}]: dispatch 2023-07-13T01:36:30.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:29 smithi137 bash[27262]: audit 1689212189.0714612 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:30.365 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27858]: debug 2023-07-13T01:36:29.997+0000 7f19e714a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-13T01:36:30.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27315]: cluster 1689212188.9504614 mon.a (mon.0) 387 : cluster 0 mgrmap e14: a(active, since 3m), standbys: d 2023-07-13T01:36:30.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27315]: audit 1689212188.950666 mon.a (mon.0) 388 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "d", "id": "d"}]: dispatch 2023-07-13T01:36:30.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:29 smithi103 bash[27315]: audit 1689212189.0714612 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:30.404 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27868]: debug 2023-07-13T01:36:30.025+0000 7f4dce890200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:30.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:29 smithi084 bash[27323]: cluster 1689212188.9504614 mon.a (mon.0) 387 : cluster 0 mgrmap e14: a(active, since 3m), standbys: d 2023-07-13T01:36:30.405 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:29 smithi084 bash[27323]: audit 1689212188.950666 mon.a (mon.0) 388 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "d", "id": "d"}]: dispatch 2023-07-13T01:36:30.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:29 smithi084 bash[27323]: audit 1689212189.0714612 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:30.417 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:29 smithi022 bash[26979]: cluster 1689212188.9504614 mon.a (mon.0) 387 : cluster 0 mgrmap e14: a(active, since 3m), standbys: d 2023-07-13T01:36:30.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:29 smithi022 bash[26979]: audit 1689212188.950666 mon.a (mon.0) 388 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "d", "id": "d"}]: dispatch 2023-07-13T01:36:30.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:29 smithi022 bash[26979]: audit 1689212189.0714612 mon.a (mon.0) 389 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:30.904 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27868]: debug 2023-07-13T01:36:30.565+0000 7f4dce890200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:36:30.904 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27868]: debug 2023-07-13T01:36:30.677+0000 7f4dce890200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:36:30.951 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[28744]: debug 2023-07-13T01:36:30.563+0000 7fae23cfe200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:36:31.257 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:31 smithi103 bash[27858]: debug 2023-07-13T01:36:31.021+0000 7f19e714a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-13T01:36:31.258 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:31 smithi103 bash[27858]: debug 2023-07-13T01:36:31.133+0000 7f19e714a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-13T01:36:31.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27315]: cluster 1689212189.7500434 mgr.a (mgr.14152) 163 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:31.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27315]: cluster 1689212190.5867424 mon.a (mon.0) 390 : cluster 0 Standby manager daemon e started 2023-07-13T01:36:31.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27315]: audit 1689212190.5874252 mon.b (mon.4) 3 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/crt"}]: dispatch 2023-07-13T01:36:31.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27315]: audit 1689212190.5901093 mon.b (mon.4) 4 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:31.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27315]: audit 1689212190.592351 mon.b (mon.4) 5 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/key"}]: dispatch 2023-07-13T01:36:31.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:30 smithi103 bash[27315]: audit 1689212190.5933118 mon.b (mon.4) 6 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:31.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[27744]: cluster 1689212189.7500434 mgr.a (mgr.14152) 163 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:31.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[27744]: cluster 1689212190.5867424 mon.a (mon.0) 390 : cluster 0 Standby manager daemon e started 2023-07-13T01:36:31.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[27744]: audit 1689212190.5874252 mon.b (mon.4) 3 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/crt"}]: dispatch 2023-07-13T01:36:31.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[27744]: audit 1689212190.5901093 mon.b (mon.4) 4 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:31.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[27744]: audit 1689212190.592351 mon.b (mon.4) 5 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/key"}]: dispatch 2023-07-13T01:36:31.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:30 smithi154 bash[27744]: audit 1689212190.5933118 mon.b (mon.4) 6 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:31.286 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.029+0000 7f4dce890200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:36:31.287 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.141+0000 7f4dce890200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:36:31.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27323]: cluster 1689212189.7500434 mgr.a (mgr.14152) 163 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:31.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27323]: cluster 1689212190.5867424 mon.a (mon.0) 390 : cluster 0 Standby manager daemon e started 2023-07-13T01:36:31.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27323]: audit 1689212190.5874252 mon.b (mon.4) 3 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/crt"}]: dispatch 2023-07-13T01:36:31.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27323]: audit 1689212190.5901093 mon.b (mon.4) 4 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:31.288 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27323]: audit 1689212190.592351 mon.b (mon.4) 5 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/key"}]: dispatch 2023-07-13T01:36:31.288 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:30 smithi084 bash[27323]: audit 1689212190.5933118 mon.b (mon.4) 6 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:31.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:30 smithi137 bash[27262]: cluster 1689212189.7500434 mgr.a (mgr.14152) 163 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:31.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:30 smithi137 bash[27262]: cluster 1689212190.5867424 mon.a (mon.0) 390 : cluster 0 Standby manager daemon e started 2023-07-13T01:36:31.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:30 smithi137 bash[27262]: audit 1689212190.5874252 mon.b (mon.4) 3 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/crt"}]: dispatch 2023-07-13T01:36:31.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:30 smithi137 bash[27262]: audit 1689212190.5901093 mon.b (mon.4) 4 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:31.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:30 smithi137 bash[27262]: audit 1689212190.592351 mon.b (mon.4) 5 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/key"}]: dispatch 2023-07-13T01:36:31.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:30 smithi137 bash[27262]: audit 1689212190.5933118 mon.b (mon.4) 6 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:31.418 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:30 smithi022 bash[26979]: cluster 1689212189.7500434 mgr.a (mgr.14152) 163 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:31.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:30 smithi022 bash[26979]: cluster 1689212190.5867424 mon.a (mon.0) 390 : cluster 0 Standby manager daemon e started 2023-07-13T01:36:31.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:30 smithi022 bash[26979]: audit 1689212190.5874252 mon.b (mon.4) 3 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/crt"}]: dispatch 2023-07-13T01:36:31.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:30 smithi022 bash[26979]: audit 1689212190.5901093 mon.b (mon.4) 4 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:31.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:30 smithi022 bash[26979]: audit 1689212190.592351 mon.b (mon.4) 5 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/e/key"}]: dispatch 2023-07-13T01:36:31.419 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:30 smithi022 bash[26979]: audit 1689212190.5933118 mon.b (mon.4) 6 : audit 0 from='mgr.? 172.21.15.154:0/3390483160' entity='mgr.e' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:31.615 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:31 smithi103 bash[27858]: debug 2023-07-13T01:36:31.253+0000 7f19e714a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-13T01:36:31.638 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.281+0000 7f4dce890200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:31.639 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.397+0000 7f4dce890200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:36:31.639 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.521+0000 7f4dce890200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:36:31.904 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.713+0000 7f4dce890200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:36:31.904 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:31 smithi084 bash[27868]: debug 2023-07-13T01:36:31.841+0000 7f4dce890200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:36:32.115 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:31 smithi103 bash[27858]: debug 2023-07-13T01:36:31.729+0000 7f19e714a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-13T01:36:32.116 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:31 smithi103 bash[27858]: debug 2023-07-13T01:36:31.957+0000 7f19e714a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-13T01:36:32.615 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27858]: debug 2023-07-13T01:36:32.365+0000 7f19e714a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-13T01:36:32.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: cluster 1689212191.3605464 mon.a (mon.0) 391 : cluster 0 mgrmap e15: a(active, since 3m), standbys: d, e 2023-07-13T01:36:32.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212191.3696399 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "e", "id": "e"}]: dispatch 2023-07-13T01:36:32.616 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: cluster 1689212191.7504618 mgr.a (mgr.14152) 164 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:32.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212191.9682558 mon.a (mon.0) 393 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212191.9778812 mon.a (mon.0) 394 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.617 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212192.0188546 mon.a (mon.0) 395 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.618 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212192.0239105 mon.a (mon.0) 396 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.618 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212192.028669 mon.a (mon.0) 397 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.618 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212192.0335772 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.618 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212192.0374844 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.619 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27315]: audit 1689212192.0414486 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: cluster 1689212191.3605464 mon.a (mon.0) 391 : cluster 0 mgrmap e15: a(active, since 3m), standbys: d, e 2023-07-13T01:36:32.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212191.3696399 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "e", "id": "e"}]: dispatch 2023-07-13T01:36:32.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: cluster 1689212191.7504618 mgr.a (mgr.14152) 164 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:32.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212191.9682558 mon.a (mon.0) 393 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212191.9778812 mon.a (mon.0) 394 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212192.0188546 mon.a (mon.0) 395 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212192.0239105 mon.a (mon.0) 396 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212192.028669 mon.a (mon.0) 397 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212192.0335772 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212192.0374844 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:32 smithi084 bash[27323]: audit 1689212192.0414486 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: cluster 1689212191.3605464 mon.a (mon.0) 391 : cluster 0 mgrmap e15: a(active, since 3m), standbys: d, e 2023-07-13T01:36:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212191.3696399 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "e", "id": "e"}]: dispatch 2023-07-13T01:36:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: cluster 1689212191.7504618 mgr.a (mgr.14152) 164 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212191.9682558 mon.a (mon.0) 393 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212191.9778812 mon.a (mon.0) 394 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212192.0188546 mon.a (mon.0) 395 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212192.0239105 mon.a (mon.0) 396 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212192.028669 mon.a (mon.0) 397 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212192.0335772 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212192.0374844 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:32 smithi022 bash[26979]: audit 1689212192.0414486 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: cluster 1689212191.3605464 mon.a (mon.0) 391 : cluster 0 mgrmap e15: a(active, since 3m), standbys: d, e 2023-07-13T01:36:32.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212191.3696399 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "e", "id": "e"}]: dispatch 2023-07-13T01:36:32.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: cluster 1689212191.7504618 mgr.a (mgr.14152) 164 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:32.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212191.9682558 mon.a (mon.0) 393 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212191.9778812 mon.a (mon.0) 394 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212192.0188546 mon.a (mon.0) 395 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212192.0239105 mon.a (mon.0) 396 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212192.028669 mon.a (mon.0) 397 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212192.0335772 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212192.0374844 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:32 smithi154 bash[27744]: audit 1689212192.0414486 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: cluster 1689212191.3605464 mon.a (mon.0) 391 : cluster 0 mgrmap e15: a(active, since 3m), standbys: d, e 2023-07-13T01:36:32.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212191.3696399 mon.a (mon.0) 392 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "e", "id": "e"}]: dispatch 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: cluster 1689212191.7504618 mgr.a (mgr.14152) 164 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212191.9682558 mon.a (mon.0) 393 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212191.9778812 mon.a (mon.0) 394 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212192.0188546 mon.a (mon.0) 395 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212192.0239105 mon.a (mon.0) 396 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212192.028669 mon.a (mon.0) 397 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212192.0335772 mon.a (mon.0) 398 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212192.0374844 mon.a (mon.0) 399 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:32.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:32 smithi137 bash[27262]: audit 1689212192.0414486 mon.a (mon.0) 400 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:33.115 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:32 smithi103 bash[27858]: debug 2023-07-13T01:36:32.853+0000 7f19e714a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-13T01:36:33.362 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:36:33.365 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27868]: debug 2023-07-13T01:36:33.069+0000 7f4dce890200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:36:33.654 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212192.5611644 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212192.5626693 mon.a (mon.0) 402 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212192.572429 mon.a (mon.0) 403 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: cephadm 1689212192.737613 mgr.a (mgr.14152) 165 : cephadm 1 Reconfiguring mgr.a (unknown last config time)... 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212192.7382424 mon.a (mon.0) 404 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212192.740245 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212192.7417243 mon.a (mon.0) 406 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: cephadm 1689212192.7433927 mgr.a (mgr.14152) 166 : cephadm 1 Reconfiguring daemon mgr.a on smithi022 2023-07-13T01:36:33.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: cluster 1689212193.0774355 mon.a (mon.0) 407 : cluster 0 Standby manager daemon b started 2023-07-13T01:36:33.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212193.0780537 mon.b (mon.4) 7 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2023-07-13T01:36:33.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212193.0788698 mon.b (mon.4) 8 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:33.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212193.080938 mon.b (mon.4) 9 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2023-07-13T01:36:33.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:33 smithi084 bash[27323]: audit 1689212193.0816395 mon.b (mon.4) 10 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:33.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212192.5611644 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212192.5626693 mon.a (mon.0) 402 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:33.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212192.572429 mon.a (mon.0) 403 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:33.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: cephadm 1689212192.737613 mgr.a (mgr.14152) 165 : cephadm 1 Reconfiguring mgr.a (unknown last config time)... 2023-07-13T01:36:33.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212192.7382424 mon.a (mon.0) 404 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:33.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212192.740245 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:33.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212192.7417243 mon.a (mon.0) 406 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: cephadm 1689212192.7433927 mgr.a (mgr.14152) 166 : cephadm 1 Reconfiguring daemon mgr.a on smithi022 2023-07-13T01:36:33.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: cluster 1689212193.0774355 mon.a (mon.0) 407 : cluster 0 Standby manager daemon b started 2023-07-13T01:36:33.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212193.0780537 mon.b (mon.4) 7 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2023-07-13T01:36:33.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212193.0788698 mon.b (mon.4) 8 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:33.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212193.080938 mon.b (mon.4) 9 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2023-07-13T01:36:33.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:33 smithi022 bash[26979]: audit 1689212193.0816395 mon.b (mon.4) 10 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:33.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212192.5611644 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212192.5626693 mon.a (mon.0) 402 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:33.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212192.572429 mon.a (mon.0) 403 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:33.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: cephadm 1689212192.737613 mgr.a (mgr.14152) 165 : cephadm 1 Reconfiguring mgr.a (unknown last config time)... 2023-07-13T01:36:33.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212192.7382424 mon.a (mon.0) 404 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:33.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212192.740245 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:33.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212192.7417243 mon.a (mon.0) 406 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: cephadm 1689212192.7433927 mgr.a (mgr.14152) 166 : cephadm 1 Reconfiguring daemon mgr.a on smithi022 2023-07-13T01:36:33.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: cluster 1689212193.0774355 mon.a (mon.0) 407 : cluster 0 Standby manager daemon b started 2023-07-13T01:36:33.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212193.0780537 mon.b (mon.4) 7 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2023-07-13T01:36:33.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212193.0788698 mon.b (mon.4) 8 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:33.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212193.080938 mon.b (mon.4) 9 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2023-07-13T01:36:33.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:33 smithi154 bash[27744]: audit 1689212193.0816395 mon.b (mon.4) 10 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:33.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212192.5611644 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212192.5626693 mon.a (mon.0) 402 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:33.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212192.572429 mon.a (mon.0) 403 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:33.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: cephadm 1689212192.737613 mgr.a (mgr.14152) 165 : cephadm 1 Reconfiguring mgr.a (unknown last config time)... 2023-07-13T01:36:33.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212192.7382424 mon.a (mon.0) 404 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:33.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212192.740245 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:33.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212192.7417243 mon.a (mon.0) 406 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: cephadm 1689212192.7433927 mgr.a (mgr.14152) 166 : cephadm 1 Reconfiguring daemon mgr.a on smithi022 2023-07-13T01:36:33.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: cluster 1689212193.0774355 mon.a (mon.0) 407 : cluster 0 Standby manager daemon b started 2023-07-13T01:36:33.820 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212193.0780537 mon.b (mon.4) 7 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2023-07-13T01:36:33.820 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212193.0788698 mon.b (mon.4) 8 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:33.820 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212193.080938 mon.b (mon.4) 9 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2023-07-13T01:36:33.820 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:33 smithi137 bash[27262]: audit 1689212193.0816395 mon.b (mon.4) 10 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:33.852 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27858]: debug 2023-07-13T01:36:33.393+0000 7f19e714a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-13T01:36:33.852 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27858]: debug 2023-07-13T01:36:33.501+0000 7f19e714a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-13T01:36:33.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212192.5611644 mon.a (mon.0) 401 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212192.5626693 mon.a (mon.0) 402 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:33.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212192.572429 mon.a (mon.0) 403 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:33.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: cephadm 1689212192.737613 mgr.a (mgr.14152) 165 : cephadm 1 Reconfiguring mgr.a (unknown last config time)... 2023-07-13T01:36:33.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212192.7382424 mon.a (mon.0) 404 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-13T01:36:33.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212192.740245 mon.a (mon.0) 405 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-13T01:36:33.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212192.7417243 mon.a (mon.0) 406 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:33.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: cephadm 1689212192.7433927 mgr.a (mgr.14152) 166 : cephadm 1 Reconfiguring daemon mgr.a on smithi022 2023-07-13T01:36:33.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: cluster 1689212193.0774355 mon.a (mon.0) 407 : cluster 0 Standby manager daemon b started 2023-07-13T01:36:33.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212193.0780537 mon.b (mon.4) 7 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/crt"}]: dispatch 2023-07-13T01:36:33.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212193.0788698 mon.b (mon.4) 8 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:33.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212193.080938 mon.b (mon.4) 9 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/b/key"}]: dispatch 2023-07-13T01:36:33.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27315]: audit 1689212193.0816395 mon.b (mon.4) 10 : audit 0 from='mgr.? 172.21.15.84:0/2816914605' entity='mgr.b' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:34.108 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27858]: debug 2023-07-13T01:36:33.845+0000 7f19e714a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-13T01:36:34.109 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:33 smithi103 bash[27858]: debug 2023-07-13T01:36:33.957+0000 7f19e714a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-13T01:36:34.365 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27858]: debug 2023-07-13T01:36:34.101+0000 7f19e714a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-13T01:36:34.365 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27858]: debug 2023-07-13T01:36:34.221+0000 7f19e714a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-13T01:36:34.366 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27858]: debug 2023-07-13T01:36:34.345+0000 7f19e714a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-13T01:36:34.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:34 smithi022 bash[26979]: cluster 1689212193.5882084 mon.a (mon.0) 408 : cluster 0 mgrmap e16: a(active, since 3m), standbys: d, e, b 2023-07-13T01:36:34.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:34 smithi022 bash[26979]: audit 1689212193.5883715 mon.a (mon.0) 409 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2023-07-13T01:36:34.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:34 smithi022 bash[26979]: cluster 1689212193.7509718 mgr.a (mgr.14152) 167 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:34.865 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27858]: debug 2023-07-13T01:36:34.529+0000 7f19e714a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-13T01:36:34.865 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27858]: debug 2023-07-13T01:36:34.657+0000 7f19e714a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-13T01:36:34.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27315]: cluster 1689212193.5882084 mon.a (mon.0) 408 : cluster 0 mgrmap e16: a(active, since 3m), standbys: d, e, b 2023-07-13T01:36:34.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27315]: audit 1689212193.5883715 mon.a (mon.0) 409 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2023-07-13T01:36:34.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:34 smithi103 bash[27315]: cluster 1689212193.7509718 mgr.a (mgr.14152) 167 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:34.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:34 smithi084 bash[27323]: cluster 1689212193.5882084 mon.a (mon.0) 408 : cluster 0 mgrmap e16: a(active, since 3m), standbys: d, e, b 2023-07-13T01:36:34.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:34 smithi084 bash[27323]: audit 1689212193.5883715 mon.a (mon.0) 409 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2023-07-13T01:36:34.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:34 smithi084 bash[27323]: cluster 1689212193.7509718 mgr.a (mgr.14152) 167 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:35.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:34 smithi154 bash[27744]: cluster 1689212193.5882084 mon.a (mon.0) 408 : cluster 0 mgrmap e16: a(active, since 3m), standbys: d, e, b 2023-07-13T01:36:35.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:34 smithi154 bash[27744]: audit 1689212193.5883715 mon.a (mon.0) 409 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2023-07-13T01:36:35.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:34 smithi154 bash[27744]: cluster 1689212193.7509718 mgr.a (mgr.14152) 167 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:35.066 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:34 smithi137 bash[27262]: cluster 1689212193.5882084 mon.a (mon.0) 408 : cluster 0 mgrmap e16: a(active, since 3m), standbys: d, e, b 2023-07-13T01:36:35.066 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:34 smithi137 bash[27262]: audit 1689212193.5883715 mon.a (mon.0) 409 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "b", "id": "b"}]: dispatch 2023-07-13T01:36:35.066 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:34 smithi137 bash[27262]: cluster 1689212193.7509718 mgr.a (mgr.14152) 167 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:36.365 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 01:36:35 smithi103 bash[27858]: debug 2023-07-13T01:36:35.865+0000 7f19e714a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-13T01:36:37.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: cluster 1689212195.7513952 mgr.a (mgr.14152) 168 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:37.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8562536 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8625953 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8676293 mon.a (mon.0) 412 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:37.116 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8706405 mon.a (mon.0) 413 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:37.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8721611 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:37.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8821952 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: cluster 1689212195.891447 mon.a (mon.0) 416 : cluster 0 Standby manager daemon c started 2023-07-13T01:36:37.117 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.8925078 mon.b (mon.4) 11 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/crt"}]: dispatch 2023-07-13T01:36:37.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.9000077 mon.b (mon.4) 12 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:37.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.902047 mon.b (mon.4) 13 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/key"}]: dispatch 2023-07-13T01:36:37.118 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:36 smithi103 bash[27315]: audit 1689212195.9030364 mon.b (mon.4) 14 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:37.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: cluster 1689212195.7513952 mgr.a (mgr.14152) 168 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:37.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8562536 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8625953 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8676293 mon.a (mon.0) 412 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:37.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8706405 mon.a (mon.0) 413 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:37.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8721611 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:37.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8821952 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: cluster 1689212195.891447 mon.a (mon.0) 416 : cluster 0 Standby manager daemon c started 2023-07-13T01:36:37.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.8925078 mon.b (mon.4) 11 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/crt"}]: dispatch 2023-07-13T01:36:37.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.9000077 mon.b (mon.4) 12 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:37.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.902047 mon.b (mon.4) 13 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/key"}]: dispatch 2023-07-13T01:36:37.159 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:36 smithi084 bash[27323]: audit 1689212195.9030364 mon.b (mon.4) 14 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:37.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: cluster 1689212195.7513952 mgr.a (mgr.14152) 168 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:37.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8562536 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8625953 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8676293 mon.a (mon.0) 412 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8706405 mon.a (mon.0) 413 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8721611 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8821952 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: cluster 1689212195.891447 mon.a (mon.0) 416 : cluster 0 Standby manager daemon c started 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.8925078 mon.b (mon.4) 11 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/crt"}]: dispatch 2023-07-13T01:36:37.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.9000077 mon.b (mon.4) 12 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:37.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.902047 mon.b (mon.4) 13 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/key"}]: dispatch 2023-07-13T01:36:37.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:36 smithi022 bash[26979]: audit 1689212195.9030364 mon.b (mon.4) 14 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:37.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: cluster 1689212195.7513952 mgr.a (mgr.14152) 168 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:37.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8562536 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8625953 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8676293 mon.a (mon.0) 412 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:37.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8706405 mon.a (mon.0) 413 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:37.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8721611 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:37.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8821952 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: cluster 1689212195.891447 mon.a (mon.0) 416 : cluster 0 Standby manager daemon c started 2023-07-13T01:36:37.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.8925078 mon.b (mon.4) 11 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/crt"}]: dispatch 2023-07-13T01:36:37.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.9000077 mon.b (mon.4) 12 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:37.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.902047 mon.b (mon.4) 13 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/key"}]: dispatch 2023-07-13T01:36:37.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:36 smithi154 bash[27744]: audit 1689212195.9030364 mon.b (mon.4) 14 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:37.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: cluster 1689212195.7513952 mgr.a (mgr.14152) 168 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:37.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8562536 mon.a (mon.0) 410 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8625953 mon.a (mon.0) 411 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8676293 mon.a (mon.0) 412 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:36:37.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8706405 mon.a (mon.0) 413 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:37.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8721611 mon.a (mon.0) 414 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:36:37.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8821952 mon.a (mon.0) 415 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:36:37.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: cluster 1689212195.891447 mon.a (mon.0) 416 : cluster 0 Standby manager daemon c started 2023-07-13T01:36:37.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.8925078 mon.b (mon.4) 11 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/crt"}]: dispatch 2023-07-13T01:36:37.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.9000077 mon.b (mon.4) 12 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-13T01:36:37.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.902047 mon.b (mon.4) 13 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/c/key"}]: dispatch 2023-07-13T01:36:37.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:36 smithi137 bash[27262]: audit 1689212195.9030364 mon.b (mon.4) 14 : audit 0 from='mgr.? 172.21.15.103:0/2014286150' entity='mgr.c' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-13T01:36:38.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:37 smithi084 bash[27323]: cluster 1689212196.8997297 mon.a (mon.0) 417 : cluster 0 mgrmap e17: a(active, since 3m), standbys: d, e, b, c 2023-07-13T01:36:38.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:37 smithi084 bash[27323]: audit 1689212196.8999104 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "c", "id": "c"}]: dispatch 2023-07-13T01:36:38.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:37 smithi084 bash[27323]: audit 1689212197.2980611 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:36:38.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:37 smithi084 bash[27323]: audit 1689212197.3043377 mon.a (mon.0) 420 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:36:38.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:37 smithi084 bash[27323]: audit 1689212197.305517 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:38.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:37 smithi022 bash[26979]: cluster 1689212196.8997297 mon.a (mon.0) 417 : cluster 0 mgrmap e17: a(active, since 3m), standbys: d, e, b, c 2023-07-13T01:36:38.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:37 smithi022 bash[26979]: audit 1689212196.8999104 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "c", "id": "c"}]: dispatch 2023-07-13T01:36:38.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:37 smithi022 bash[26979]: audit 1689212197.2980611 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:36:38.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:37 smithi022 bash[26979]: audit 1689212197.3043377 mon.a (mon.0) 420 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:36:38.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:37 smithi022 bash[26979]: audit 1689212197.305517 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:38.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:37 smithi154 bash[27744]: cluster 1689212196.8997297 mon.a (mon.0) 417 : cluster 0 mgrmap e17: a(active, since 3m), standbys: d, e, b, c 2023-07-13T01:36:38.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:37 smithi154 bash[27744]: audit 1689212196.8999104 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "c", "id": "c"}]: dispatch 2023-07-13T01:36:38.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:37 smithi154 bash[27744]: audit 1689212197.2980611 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:36:38.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:37 smithi154 bash[27744]: audit 1689212197.3043377 mon.a (mon.0) 420 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:36:38.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:37 smithi154 bash[27744]: audit 1689212197.305517 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:38.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:37 smithi137 bash[27262]: cluster 1689212196.8997297 mon.a (mon.0) 417 : cluster 0 mgrmap e17: a(active, since 3m), standbys: d, e, b, c 2023-07-13T01:36:38.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:37 smithi137 bash[27262]: audit 1689212196.8999104 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "c", "id": "c"}]: dispatch 2023-07-13T01:36:38.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:37 smithi137 bash[27262]: audit 1689212197.2980611 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:36:38.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:37 smithi137 bash[27262]: audit 1689212197.3043377 mon.a (mon.0) 420 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:36:38.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:37 smithi137 bash[27262]: audit 1689212197.305517 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:38.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:37 smithi103 bash[27315]: cluster 1689212196.8997297 mon.a (mon.0) 417 : cluster 0 mgrmap e17: a(active, since 3m), standbys: d, e, b, c 2023-07-13T01:36:38.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:37 smithi103 bash[27315]: audit 1689212196.8999104 mon.a (mon.0) 418 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "c", "id": "c"}]: dispatch 2023-07-13T01:36:38.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:37 smithi103 bash[27315]: audit 1689212197.2980611 mon.a (mon.0) 419 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:36:38.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:37 smithi103 bash[27315]: audit 1689212197.3043377 mon.a (mon.0) 420 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:36:38.366 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:37 smithi103 bash[27315]: audit 1689212197.305517 mon.a (mon.0) 421 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:39.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:38 smithi084 bash[27323]: audit 1689212197.2901287 mgr.a (mgr.14152) 169 : audit 0 from='client.14245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:39.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:38 smithi084 bash[27323]: cluster 1689212197.7518487 mgr.a (mgr.14152) 170 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:39.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:38 smithi022 bash[26979]: audit 1689212197.2901287 mgr.a (mgr.14152) 169 : audit 0 from='client.14245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:39.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:38 smithi022 bash[26979]: cluster 1689212197.7518487 mgr.a (mgr.14152) 170 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:39.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:38 smithi154 bash[27744]: audit 1689212197.2901287 mgr.a (mgr.14152) 169 : audit 0 from='client.14245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:39.269 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:38 smithi154 bash[27744]: cluster 1689212197.7518487 mgr.a (mgr.14152) 170 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:39.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:38 smithi137 bash[27262]: audit 1689212197.2901287 mgr.a (mgr.14152) 169 : audit 0 from='client.14245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:39.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:38 smithi137 bash[27262]: cluster 1689212197.7518487 mgr.a (mgr.14152) 170 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:39.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:38 smithi103 bash[27315]: audit 1689212197.2901287 mgr.a (mgr.14152) 169 : audit 0 from='client.14245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:36:39.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:38 smithi103 bash[27315]: cluster 1689212197.7518487 mgr.a (mgr.14152) 170 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:40.615 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:40 smithi103 bash[27315]: cluster 1689212199.7523067 mgr.a (mgr.14152) 171 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:40.654 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:40 smithi084 bash[27323]: cluster 1689212199.7523067 mgr.a (mgr.14152) 171 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:40.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:40 smithi022 bash[26979]: cluster 1689212199.7523067 mgr.a (mgr.14152) 171 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:40.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:40 smithi154 bash[27744]: cluster 1689212199.7523067 mgr.a (mgr.14152) 171 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:40.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:40 smithi137 bash[27262]: cluster 1689212199.7523067 mgr.a (mgr.14152) 171 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:43.065 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:42 smithi137 bash[27262]: cluster 1689212201.7528195 mgr.a (mgr.14152) 172 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:43.091 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:42 smithi022 bash[26979]: cluster 1689212201.7528195 mgr.a (mgr.14152) 172 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:43.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:42 smithi103 bash[27315]: cluster 1689212201.7528195 mgr.a (mgr.14152) 172 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:43.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:42 smithi084 bash[27323]: cluster 1689212201.7528195 mgr.a (mgr.14152) 172 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:43.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:42 smithi154 bash[27744]: cluster 1689212201.7528195 mgr.a (mgr.14152) 172 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:45.065 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:44 smithi137 bash[27262]: cluster 1689212203.753295 mgr.a (mgr.14152) 173 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:45.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:44 smithi103 bash[27315]: cluster 1689212203.753295 mgr.a (mgr.14152) 173 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:45.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:44 smithi084 bash[27323]: cluster 1689212203.753295 mgr.a (mgr.14152) 173 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:45.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:44 smithi022 bash[26979]: cluster 1689212203.753295 mgr.a (mgr.14152) 173 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:45.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:44 smithi154 bash[27744]: cluster 1689212203.753295 mgr.a (mgr.14152) 173 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:47.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:46 smithi103 bash[27315]: cluster 1689212205.7537997 mgr.a (mgr.14152) 174 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:47.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:46 smithi103 bash[27315]: audit 1689212205.8949637 mon.a (mon.0) 422 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]: dispatch 2023-07-13T01:36:47.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:46 smithi103 bash[27315]: audit 1689212205.9029388 mon.a (mon.0) 423 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]': finished 2023-07-13T01:36:47.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:46 smithi103 bash[27315]: cluster 1689212205.903081 mon.a (mon.0) 424 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2023-07-13T01:36:47.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:46 smithi103 bash[27315]: audit 1689212205.903247 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:36:47.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:46 smithi103 bash[27315]: audit 1689212206.659296 mon.a (mon.0) 426 : audit 0 from='client.? 172.21.15.22:0/494484906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:36:47.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:46 smithi084 bash[27323]: cluster 1689212205.7537997 mgr.a (mgr.14152) 174 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:47.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:46 smithi084 bash[27323]: audit 1689212205.8949637 mon.a (mon.0) 422 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]: dispatch 2023-07-13T01:36:47.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:46 smithi084 bash[27323]: audit 1689212205.9029388 mon.a (mon.0) 423 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]': finished 2023-07-13T01:36:47.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:46 smithi084 bash[27323]: cluster 1689212205.903081 mon.a (mon.0) 424 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2023-07-13T01:36:47.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:46 smithi084 bash[27323]: audit 1689212205.903247 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:36:47.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:46 smithi084 bash[27323]: audit 1689212206.659296 mon.a (mon.0) 426 : audit 0 from='client.? 172.21.15.22:0/494484906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:36:47.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:46 smithi022 bash[26979]: cluster 1689212205.7537997 mgr.a (mgr.14152) 174 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:47.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:46 smithi022 bash[26979]: audit 1689212205.8949637 mon.a (mon.0) 422 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]: dispatch 2023-07-13T01:36:47.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:46 smithi022 bash[26979]: audit 1689212205.9029388 mon.a (mon.0) 423 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]': finished 2023-07-13T01:36:47.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:46 smithi022 bash[26979]: cluster 1689212205.903081 mon.a (mon.0) 424 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2023-07-13T01:36:47.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:46 smithi022 bash[26979]: audit 1689212205.903247 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:36:47.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:46 smithi022 bash[26979]: audit 1689212206.659296 mon.a (mon.0) 426 : audit 0 from='client.? 172.21.15.22:0/494484906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:36:47.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:46 smithi154 bash[27744]: cluster 1689212205.7537997 mgr.a (mgr.14152) 174 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:47.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:46 smithi154 bash[27744]: audit 1689212205.8949637 mon.a (mon.0) 422 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]: dispatch 2023-07-13T01:36:47.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:46 smithi154 bash[27744]: audit 1689212205.9029388 mon.a (mon.0) 423 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]': finished 2023-07-13T01:36:47.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:46 smithi154 bash[27744]: cluster 1689212205.903081 mon.a (mon.0) 424 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2023-07-13T01:36:47.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:46 smithi154 bash[27744]: audit 1689212205.903247 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:36:47.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:46 smithi154 bash[27744]: audit 1689212206.659296 mon.a (mon.0) 426 : audit 0 from='client.? 172.21.15.22:0/494484906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:36:47.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:46 smithi137 bash[27262]: cluster 1689212205.7537997 mgr.a (mgr.14152) 174 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:47.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:46 smithi137 bash[27262]: audit 1689212205.8949637 mon.a (mon.0) 422 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]: dispatch 2023-07-13T01:36:47.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:46 smithi137 bash[27262]: audit 1689212205.9029388 mon.a (mon.0) 423 : audit 1 from='client.? 172.21.15.22:0/2273925419' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17948ca2-f853-484e-8ed0-6ecaf32427c6"}]': finished 2023-07-13T01:36:47.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:46 smithi137 bash[27262]: cluster 1689212205.903081 mon.a (mon.0) 424 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2023-07-13T01:36:47.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:46 smithi137 bash[27262]: audit 1689212205.903247 mon.a (mon.0) 425 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:36:47.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:46 smithi137 bash[27262]: audit 1689212206.659296 mon.a (mon.0) 426 : audit 0 from='client.? 172.21.15.22:0/494484906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:36:49.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:48 smithi103 bash[27315]: cluster 1689212207.754343 mgr.a (mgr.14152) 175 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:49.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:48 smithi084 bash[27323]: cluster 1689212207.754343 mgr.a (mgr.14152) 175 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:49.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:48 smithi022 bash[26979]: cluster 1689212207.754343 mgr.a (mgr.14152) 175 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:49.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:48 smithi154 bash[27744]: cluster 1689212207.754343 mgr.a (mgr.14152) 175 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:49.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:48 smithi137 bash[27262]: cluster 1689212207.754343 mgr.a (mgr.14152) 175 : cluster 0 pgmap v99: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:50.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:50 smithi103 bash[27315]: cluster 1689212209.7549112 mgr.a (mgr.14152) 176 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:50.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:50 smithi084 bash[27323]: cluster 1689212209.7549112 mgr.a (mgr.14152) 176 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:50.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:50 smithi022 bash[26979]: cluster 1689212209.7549112 mgr.a (mgr.14152) 176 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:50.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:50 smithi154 bash[27744]: cluster 1689212209.7549112 mgr.a (mgr.14152) 176 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:50.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:50 smithi137 bash[27262]: cluster 1689212209.7549112 mgr.a (mgr.14152) 176 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:53.065 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:52 smithi137 bash[27262]: cluster 1689212211.755396 mgr.a (mgr.14152) 177 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:53.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:52 smithi103 bash[27315]: cluster 1689212211.755396 mgr.a (mgr.14152) 177 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:53.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:52 smithi084 bash[27323]: cluster 1689212211.755396 mgr.a (mgr.14152) 177 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:53.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:52 smithi022 bash[26979]: cluster 1689212211.755396 mgr.a (mgr.14152) 177 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:53.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:52 smithi154 bash[27744]: cluster 1689212211.755396 mgr.a (mgr.14152) 177 : cluster 0 pgmap v101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:55.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:54 smithi103 bash[27315]: cluster 1689212213.7559433 mgr.a (mgr.14152) 178 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:55.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:54 smithi084 bash[27323]: cluster 1689212213.7559433 mgr.a (mgr.14152) 178 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:55.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:54 smithi022 bash[26979]: cluster 1689212213.7559433 mgr.a (mgr.14152) 178 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:55.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:54 smithi154 bash[27744]: cluster 1689212213.7559433 mgr.a (mgr.14152) 178 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:55.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:54 smithi137 bash[27262]: cluster 1689212213.7559433 mgr.a (mgr.14152) 178 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:57.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:56 smithi103 bash[27315]: cluster 1689212215.7564116 mgr.a (mgr.14152) 179 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:57.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:56 smithi084 bash[27323]: cluster 1689212215.7564116 mgr.a (mgr.14152) 179 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:57.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:56 smithi022 bash[26979]: cluster 1689212215.7564116 mgr.a (mgr.14152) 179 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:57.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:56 smithi154 bash[27744]: cluster 1689212215.7564116 mgr.a (mgr.14152) 179 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:57.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:56 smithi137 bash[27262]: cluster 1689212215.7564116 mgr.a (mgr.14152) 179 : cluster 0 pgmap v103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:59.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:58 smithi022 bash[26979]: cluster 1689212217.7567225 mgr.a (mgr.14152) 180 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:59.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:58 smithi022 bash[26979]: audit 1689212218.6857936 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-13T01:36:59.094 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:58 smithi022 bash[26979]: audit 1689212218.6871767 mon.a (mon.0) 428 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:59.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:58 smithi103 bash[27315]: cluster 1689212217.7567225 mgr.a (mgr.14152) 180 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:59.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:58 smithi103 bash[27315]: audit 1689212218.6857936 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-13T01:36:59.115 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:58 smithi103 bash[27315]: audit 1689212218.6871767 mon.a (mon.0) 428 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:59.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:58 smithi084 bash[27323]: cluster 1689212217.7567225 mgr.a (mgr.14152) 180 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:59.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:58 smithi084 bash[27323]: audit 1689212218.6857936 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-13T01:36:59.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:58 smithi084 bash[27323]: audit 1689212218.6871767 mon.a (mon.0) 428 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:59.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:58 smithi154 bash[27744]: cluster 1689212217.7567225 mgr.a (mgr.14152) 180 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:59.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:58 smithi154 bash[27744]: audit 1689212218.6857936 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-13T01:36:59.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:58 smithi154 bash[27744]: audit 1689212218.6871767 mon.a (mon.0) 428 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:36:59.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:58 smithi137 bash[27262]: cluster 1689212217.7567225 mgr.a (mgr.14152) 180 : cluster 0 pgmap v104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:36:59.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:58 smithi137 bash[27262]: audit 1689212218.6857936 mon.a (mon.0) 427 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-13T01:36:59.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:58 smithi137 bash[27262]: audit 1689212218.6871767 mon.a (mon.0) 428 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:00.110 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:36:59 smithi022 bash[26979]: cephadm 1689212218.688368 mgr.a (mgr.14152) 181 : cephadm 1 Deploying daemon osd.0 on smithi022 2023-07-13T01:37:00.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:36:59 smithi103 bash[27315]: cephadm 1689212218.688368 mgr.a (mgr.14152) 181 : cephadm 1 Deploying daemon osd.0 on smithi022 2023-07-13T01:37:00.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:36:59 smithi084 bash[27323]: cephadm 1689212218.688368 mgr.a (mgr.14152) 181 : cephadm 1 Deploying daemon osd.0 on smithi022 2023-07-13T01:37:00.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:36:59 smithi154 bash[27744]: cephadm 1689212218.688368 mgr.a (mgr.14152) 181 : cephadm 1 Deploying daemon osd.0 on smithi022 2023-07-13T01:37:00.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:36:59 smithi137 bash[27262]: cephadm 1689212218.688368 mgr.a (mgr.14152) 181 : cephadm 1 Deploying daemon osd.0 on smithi022 2023-07-13T01:37:01.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:00 smithi103 bash[27315]: cluster 1689212219.757146 mgr.a (mgr.14152) 182 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:01.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:00 smithi084 bash[27323]: cluster 1689212219.757146 mgr.a (mgr.14152) 182 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:01.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:00 smithi022 bash[26979]: cluster 1689212219.757146 mgr.a (mgr.14152) 182 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:01.267 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:00 smithi154 bash[27744]: cluster 1689212219.757146 mgr.a (mgr.14152) 182 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:01.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:00 smithi137 bash[27262]: cluster 1689212219.757146 mgr.a (mgr.14152) 182 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:03.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:02 smithi103 bash[27315]: cluster 1689212221.7576017 mgr.a (mgr.14152) 183 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:03.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:02 smithi084 bash[27323]: cluster 1689212221.7576017 mgr.a (mgr.14152) 183 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:03.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:02 smithi022 bash[26979]: cluster 1689212221.7576017 mgr.a (mgr.14152) 183 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:03.267 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:02 smithi154 bash[27744]: cluster 1689212221.7576017 mgr.a (mgr.14152) 183 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:03.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:02 smithi137 bash[27262]: cluster 1689212221.7576017 mgr.a (mgr.14152) 183 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:04.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:04 smithi103 bash[27315]: audit 1689212223.3308637 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:04 smithi103 bash[27315]: audit 1689212223.3382206 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:04 smithi103 bash[27315]: audit 1689212223.3386586 mon.a (mon.0) 431 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:04.614 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:04 smithi103 bash[27315]: cluster 1689212223.7579381 mgr.a (mgr.14152) 184 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:04.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:04 smithi022 bash[26979]: audit 1689212223.3308637 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:04 smithi022 bash[26979]: audit 1689212223.3382206 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:04 smithi022 bash[26979]: audit 1689212223.3386586 mon.a (mon.0) 431 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:04.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:04 smithi022 bash[26979]: cluster 1689212223.7579381 mgr.a (mgr.14152) 184 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:04.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:04 smithi084 bash[27323]: audit 1689212223.3308637 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:04 smithi084 bash[27323]: audit 1689212223.3382206 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:04 smithi084 bash[27323]: audit 1689212223.3386586 mon.a (mon.0) 431 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:04.654 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:04 smithi084 bash[27323]: cluster 1689212223.7579381 mgr.a (mgr.14152) 184 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:04.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:04 smithi154 bash[27744]: audit 1689212223.3308637 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:04 smithi154 bash[27744]: audit 1689212223.3382206 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:04 smithi154 bash[27744]: audit 1689212223.3386586 mon.a (mon.0) 431 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:04.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:04 smithi154 bash[27744]: cluster 1689212223.7579381 mgr.a (mgr.14152) 184 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:04.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:04 smithi137 bash[27262]: audit 1689212223.3308637 mon.a (mon.0) 429 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:04 smithi137 bash[27262]: audit 1689212223.3382206 mon.a (mon.0) 430 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:04.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:04 smithi137 bash[27262]: audit 1689212223.3386586 mon.a (mon.0) 431 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:04.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:04 smithi137 bash[27262]: cluster 1689212223.7579381 mgr.a (mgr.14152) 184 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:07.065 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:06 smithi137 bash[27262]: cluster 1689212225.7583547 mgr.a (mgr.14152) 185 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:07.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:06 smithi022 bash[26979]: cluster 1689212225.7583547 mgr.a (mgr.14152) 185 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:07.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:06 smithi103 bash[27315]: cluster 1689212225.7583547 mgr.a (mgr.14152) 185 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:07.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:06 smithi084 bash[27323]: cluster 1689212225.7583547 mgr.a (mgr.14152) 185 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:07.267 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:06 smithi154 bash[27744]: cluster 1689212225.7583547 mgr.a (mgr.14152) 185 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:09.114 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:08 smithi103 bash[27315]: cluster 1689212227.758778 mgr.a (mgr.14152) 186 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:09.151 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:08 smithi154 bash[27744]: cluster 1689212227.758778 mgr.a (mgr.14152) 186 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:09.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:08 smithi084 bash[27323]: cluster 1689212227.758778 mgr.a (mgr.14152) 186 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:09.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:08 smithi022 bash[26979]: cluster 1689212227.758778 mgr.a (mgr.14152) 186 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:09.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:08 smithi137 bash[27262]: cluster 1689212227.758778 mgr.a (mgr.14152) 186 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:11.138 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:10 smithi022 bash[26979]: cluster 1689212229.7590778 mgr.a (mgr.14152) 187 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:11.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:10 smithi022 bash[26979]: audit 1689212229.8897545 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:10 smithi022 bash[26979]: audit 1689212229.8965697 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:10 smithi022 bash[26979]: audit 1689212230.3715923 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:11.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:10 smithi022 bash[26979]: audit 1689212230.3733826 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:11.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:10 smithi022 bash[26979]: audit 1689212230.3834722 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:10 smithi084 bash[27323]: cluster 1689212229.7590778 mgr.a (mgr.14152) 187 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:11.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:10 smithi084 bash[27323]: audit 1689212229.8897545 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:10 smithi084 bash[27323]: audit 1689212229.8965697 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:10 smithi084 bash[27323]: audit 1689212230.3715923 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:11.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:10 smithi084 bash[27323]: audit 1689212230.3733826 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:11.154 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:10 smithi084 bash[27323]: audit 1689212230.3834722 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.267 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:10 smithi154 bash[27744]: cluster 1689212229.7590778 mgr.a (mgr.14152) 187 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:11.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:10 smithi154 bash[27744]: audit 1689212229.8897545 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:10 smithi154 bash[27744]: audit 1689212229.8965697 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:10 smithi154 bash[27744]: audit 1689212230.3715923 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:11.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:10 smithi154 bash[27744]: audit 1689212230.3733826 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:11.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:10 smithi154 bash[27744]: audit 1689212230.3834722 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:10 smithi137 bash[27262]: cluster 1689212229.7590778 mgr.a (mgr.14152) 187 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:11.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:10 smithi137 bash[27262]: audit 1689212229.8897545 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:10 smithi137 bash[27262]: audit 1689212229.8965697 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:10 smithi137 bash[27262]: audit 1689212230.3715923 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:11.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:10 smithi137 bash[27262]: audit 1689212230.3733826 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:11.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:10 smithi137 bash[27262]: audit 1689212230.3834722 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:10 smithi103 bash[27315]: cluster 1689212229.7590778 mgr.a (mgr.14152) 187 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:11.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:10 smithi103 bash[27315]: audit 1689212229.8897545 mon.a (mon.0) 432 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:10 smithi103 bash[27315]: audit 1689212229.8965697 mon.a (mon.0) 433 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:11.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:10 smithi103 bash[27315]: audit 1689212230.3715923 mon.a (mon.0) 434 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:11.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:10 smithi103 bash[27315]: audit 1689212230.3733826 mon.a (mon.0) 435 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:11.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:10 smithi103 bash[27315]: audit 1689212230.3834722 mon.a (mon.0) 436 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:12.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:11 smithi084 bash[27323]: cluster 1689212230.3762336 mgr.a (mgr.14152) 188 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:12.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:11 smithi084 bash[27323]: cluster 1689212231.366431 mon.a (mon.0) 437 : cluster 3 Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:37:12.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:11 smithi022 bash[26979]: cluster 1689212230.3762336 mgr.a (mgr.14152) 188 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:12.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:11 smithi022 bash[26979]: cluster 1689212231.366431 mon.a (mon.0) 437 : cluster 3 Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:37:12.267 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:11 smithi154 bash[27744]: cluster 1689212230.3762336 mgr.a (mgr.14152) 188 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:12.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:11 smithi154 bash[27744]: cluster 1689212231.366431 mon.a (mon.0) 437 : cluster 3 Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:37:12.314 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:11 smithi137 bash[27262]: cluster 1689212230.3762336 mgr.a (mgr.14152) 188 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:12.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:11 smithi137 bash[27262]: cluster 1689212231.366431 mon.a (mon.0) 437 : cluster 3 Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:37:12.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:11 smithi103 bash[27315]: cluster 1689212230.3762336 mgr.a (mgr.14152) 188 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:12.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:11 smithi103 bash[27315]: cluster 1689212231.366431 mon.a (mon.0) 437 : cluster 3 Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:37:13.377 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2023-07-13T01:37:14.052 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service 2023-07-13T01:37:14.054 INFO:tasks.cephadm:Deploying osd.1 on smithi022 with /dev/vg_nvme/lv_3... 2023-07-13T01:37:14.055 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-13T01:37:14.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:13 smithi084 bash[27323]: cluster 1689212232.376643 mgr.a (mgr.14152) 189 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:14.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:13 smithi084 bash[27323]: audit 1689212233.350868 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:13 smithi084 bash[27323]: audit 1689212233.357532 mon.a (mon.0) 439 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:13 smithi084 bash[27323]: audit 1689212233.3711617 mon.a (mon.0) 440 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:14.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:13 smithi022 bash[26979]: cluster 1689212232.376643 mgr.a (mgr.14152) 189 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:14.166 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:13 smithi022 bash[26979]: audit 1689212233.350868 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:13 smithi022 bash[26979]: audit 1689212233.357532 mon.a (mon.0) 439 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.167 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:13 smithi022 bash[26979]: audit 1689212233.3711617 mon.a (mon.0) 440 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:14.243 INFO:journalctl@ceph.osd.0.smithi022.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:37:14.267 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:13 smithi154 bash[27744]: cluster 1689212232.376643 mgr.a (mgr.14152) 189 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:14.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:13 smithi154 bash[27744]: audit 1689212233.350868 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:13 smithi154 bash[27744]: audit 1689212233.357532 mon.a (mon.0) 439 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.268 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:13 smithi154 bash[27744]: audit 1689212233.3711617 mon.a (mon.0) 440 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:14.314 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:13 smithi137 bash[27262]: cluster 1689212232.376643 mgr.a (mgr.14152) 189 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:14.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:13 smithi137 bash[27262]: audit 1689212233.350868 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:13 smithi137 bash[27262]: audit 1689212233.357532 mon.a (mon.0) 439 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.315 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:13 smithi137 bash[27262]: audit 1689212233.3711617 mon.a (mon.0) 440 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:14.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:13 smithi103 bash[27315]: cluster 1689212232.376643 mgr.a (mgr.14152) 189 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:14.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:13 smithi103 bash[27315]: audit 1689212233.350868 mon.a (mon.0) 438 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:13 smithi103 bash[27315]: audit 1689212233.357532 mon.a (mon.0) 439 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:14.365 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:13 smithi103 bash[27315]: audit 1689212233.3711617 mon.a (mon.0) 440 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:37:15.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:15 smithi084 bash[27323]: cluster 1689212234.377115 mgr.a (mgr.14152) 190 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:15.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:15 smithi022 bash[26979]: cluster 1689212234.377115 mgr.a (mgr.14152) 190 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:15.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:15 smithi154 bash[27744]: cluster 1689212234.377115 mgr.a (mgr.14152) 190 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:15.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:15 smithi137 bash[27262]: cluster 1689212234.377115 mgr.a (mgr.14152) 190 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:15.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:15 smithi103 bash[27315]: cluster 1689212234.377115 mgr.a (mgr.14152) 190 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:17.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:17 smithi154 bash[27744]: cluster 1689212236.3775663 mgr.a (mgr.14152) 191 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:17.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:17 smithi137 bash[27262]: cluster 1689212236.3775663 mgr.a (mgr.14152) 191 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:17.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:17 smithi103 bash[27315]: cluster 1689212236.3775663 mgr.a (mgr.14152) 191 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:17.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:17 smithi084 bash[27323]: cluster 1689212236.3775663 mgr.a (mgr.14152) 191 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:17.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:17 smithi022 bash[26979]: cluster 1689212236.3775663 mgr.a (mgr.14152) 191 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:18.214 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:37:19.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:18 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:37:19.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:18 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:37:19.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:18 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:37:19.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:19 smithi154 bash[27744]: cluster 1689212238.3779674 mgr.a (mgr.14152) 192 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:19.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:19 smithi137 bash[27262]: cluster 1689212238.3779674 mgr.a (mgr.14152) 192 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:19.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:19 smithi103 bash[27315]: cluster 1689212238.3779674 mgr.a (mgr.14152) 192 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:19.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:19 smithi084 bash[27323]: cluster 1689212238.3779674 mgr.a (mgr.14152) 192 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:19.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:19 smithi022 bash[26979]: cluster 1689212238.3779674 mgr.a (mgr.14152) 192 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:21.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:21 smithi022 bash[38865]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:37:21.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:21 smithi022 bash[38865]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:37:21.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:21 smithi022 bash[38865]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:37:21.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:21 smithi022 bash[38865]: --> Failed to activate any OSD(s) 2023-07-13T01:37:21.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:21 smithi022 bash[26979]: cluster 1689212240.378273 mgr.a (mgr.14152) 193 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:21.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:21 smithi154 bash[27744]: cluster 1689212240.378273 mgr.a (mgr.14152) 193 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:21.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:21 smithi137 bash[27262]: cluster 1689212240.378273 mgr.a (mgr.14152) 193 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:21.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:21 smithi103 bash[27315]: cluster 1689212240.378273 mgr.a (mgr.14152) 193 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:21.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:21 smithi084 bash[27323]: cluster 1689212240.378273 mgr.a (mgr.14152) 193 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:23.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:23 smithi154 bash[27744]: cluster 1689212242.3787346 mgr.a (mgr.14152) 194 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:23.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:23 smithi137 bash[27262]: cluster 1689212242.3787346 mgr.a (mgr.14152) 194 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:23.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:23 smithi103 bash[27315]: cluster 1689212242.3787346 mgr.a (mgr.14152) 194 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:23.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:23 smithi084 bash[27323]: cluster 1689212242.3787346 mgr.a (mgr.14152) 194 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:23.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:23 smithi022 bash[26979]: cluster 1689212242.3787346 mgr.a (mgr.14152) 194 : cluster 0 pgmap v117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:24.785 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:24 smithi022 bash[39129]: debug 2023-07-13T01:37:24.737+0000 7f5338894700 1 -- 172.21.15.22:0/1373383308 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562ed9ff6d00 con 0x562eda04cc00 2023-07-13T01:37:24.785 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:24 smithi022 bash[39129]: debug 2023-07-13T01:37:24.737+0000 7f5341a19640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:37:25.272 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-13T01:37:25.272 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-13T01:37:25.272 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2023-07-13T01:37:25.273 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2023-07-13T01:37:25.273 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123496 s, 849 MB/s 2023-07-13T01:37:25.273 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2023-07-13T01:37:25.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:25 smithi084 bash[27323]: cluster 1689212244.3789866 mgr.a (mgr.14152) 195 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:25.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:25 smithi022 bash[26979]: cluster 1689212244.3789866 mgr.a (mgr.14152) 195 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:25.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:25 smithi154 bash[27744]: cluster 1689212244.3789866 mgr.a (mgr.14152) 195 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:25.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:25 smithi137 bash[27262]: cluster 1689212244.3789866 mgr.a (mgr.14152) 195 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:25.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:25 smithi103 bash[27315]: cluster 1689212244.3789866 mgr.a (mgr.14152) 195 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:26.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:25 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:37:26.795 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2023-07-13T01:37:27.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: cluster 1689212246.379336 mgr.a (mgr.14152) 196 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: cephadm 1689212246.4791088 mgr.a (mgr.14152) 197 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:37:27.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.4876888 mon.a (mon.0) 441 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.4944968 mon.a (mon.0) 442 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.4957614 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: cephadm 1689212246.4968705 mgr.a (mgr.14152) 198 : cephadm 1 Adjusting osd_memory_target on smithi022 to 17269M 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.5030677 mon.a (mon.0) 444 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.504414 mon.a (mon.0) 445 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.505565 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: cluster 1689212246.5076544 mgr.a (mgr.14152) 199 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: cluster 1689212246.507937 mgr.a (mgr.14152) 200 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.763 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:27 smithi022 bash[26979]: audit 1689212246.513882 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: cluster 1689212246.379336 mgr.a (mgr.14152) 196 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: cephadm 1689212246.4791088 mgr.a (mgr.14152) 197 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:37:27.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.4876888 mon.a (mon.0) 441 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.4944968 mon.a (mon.0) 442 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.4957614 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:37:27.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: cephadm 1689212246.4968705 mgr.a (mgr.14152) 198 : cephadm 1 Adjusting osd_memory_target on smithi022 to 17269M 2023-07-13T01:37:27.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.5030677 mon.a (mon.0) 444 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.504414 mon.a (mon.0) 445 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:27.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.505565 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:27.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: cluster 1689212246.5076544 mgr.a (mgr.14152) 199 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: cluster 1689212246.507937 mgr.a (mgr.14152) 200 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:27 smithi154 bash[27744]: audit 1689212246.513882 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: cluster 1689212246.379336 mgr.a (mgr.14152) 196 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: cephadm 1689212246.4791088 mgr.a (mgr.14152) 197 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.4876888 mon.a (mon.0) 441 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.4944968 mon.a (mon.0) 442 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.4957614 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: cephadm 1689212246.4968705 mgr.a (mgr.14152) 198 : cephadm 1 Adjusting osd_memory_target on smithi022 to 17269M 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.5030677 mon.a (mon.0) 444 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.504414 mon.a (mon.0) 445 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:27.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.505565 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:27.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: cluster 1689212246.5076544 mgr.a (mgr.14152) 199 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: cluster 1689212246.507937 mgr.a (mgr.14152) 200 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:27 smithi137 bash[27262]: audit 1689212246.513882 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: cluster 1689212246.379336 mgr.a (mgr.14152) 196 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: cephadm 1689212246.4791088 mgr.a (mgr.14152) 197 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:37:27.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.4876888 mon.a (mon.0) 441 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.4944968 mon.a (mon.0) 442 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.4957614 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:37:27.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: cephadm 1689212246.4968705 mgr.a (mgr.14152) 198 : cephadm 1 Adjusting osd_memory_target on smithi022 to 17269M 2023-07-13T01:37:27.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.5030677 mon.a (mon.0) 444 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.504414 mon.a (mon.0) 445 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:27.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.505565 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:27.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: cluster 1689212246.5076544 mgr.a (mgr.14152) 199 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: cluster 1689212246.507937 mgr.a (mgr.14152) 200 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:27 smithi103 bash[27315]: audit 1689212246.513882 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: cluster 1689212246.379336 mgr.a (mgr.14152) 196 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: cephadm 1689212246.4791088 mgr.a (mgr.14152) 197 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:37:27.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.4876888 mon.a (mon.0) 441 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.4944968 mon.a (mon.0) 442 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.4957614 mon.a (mon.0) 443 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:37:27.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: cephadm 1689212246.4968705 mgr.a (mgr.14152) 198 : cephadm 1 Adjusting osd_memory_target on smithi022 to 17269M 2023-07-13T01:37:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.5030677 mon.a (mon.0) 444 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.504414 mon.a (mon.0) 445 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.505565 mon.a (mon.0) 446 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:37:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: cluster 1689212246.5076544 mgr.a (mgr.14152) 199 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: cluster 1689212246.507937 mgr.a (mgr.14152) 200 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:27 smithi084 bash[27323]: audit 1689212246.513882 mon.a (mon.0) 447 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:37:28.915 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:28 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:37:29.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:29 smithi103 bash[27315]: cluster 1689212248.5084062 mgr.a (mgr.14152) 201 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:29.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:29 smithi084 bash[27323]: cluster 1689212248.5084062 mgr.a (mgr.14152) 201 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:29.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:29 smithi022 bash[26979]: cluster 1689212248.5084062 mgr.a (mgr.14152) 201 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:30.017 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:29 smithi154 bash[27744]: cluster 1689212248.5084062 mgr.a (mgr.14152) 201 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:30.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:29 smithi137 bash[27262]: cluster 1689212248.5084062 mgr.a (mgr.14152) 201 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:31.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:31 smithi103 bash[27315]: cluster 1689212250.5088482 mgr.a (mgr.14152) 202 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:31.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:31 smithi084 bash[27323]: cluster 1689212250.5088482 mgr.a (mgr.14152) 202 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:31.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:31 smithi022 bash[26979]: cluster 1689212250.5088482 mgr.a (mgr.14152) 202 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:32.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:31 smithi154 bash[27744]: cluster 1689212250.5088482 mgr.a (mgr.14152) 202 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:32.021 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:37:32.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:31 smithi137 bash[27262]: cluster 1689212250.5088482 mgr.a (mgr.14152) 202 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:33.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:33 smithi022 bash[26979]: cluster 1689212252.509367 mgr.a (mgr.14152) 203 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:33.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:33 smithi103 bash[27315]: cluster 1689212252.509367 mgr.a (mgr.14152) 203 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:33.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:33 smithi084 bash[27323]: cluster 1689212252.509367 mgr.a (mgr.14152) 203 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:34.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:33 smithi154 bash[27744]: cluster 1689212252.509367 mgr.a (mgr.14152) 203 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:34.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:33 smithi137 bash[27262]: cluster 1689212252.509367 mgr.a (mgr.14152) 203 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:35.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:35 smithi084 bash[27323]: cluster 1689212254.5098684 mgr.a (mgr.14152) 204 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:35.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:35 smithi084 bash[27323]: audit 1689212255.241934 mon.a (mon.0) 448 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:37:35.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:35 smithi084 bash[27323]: audit 1689212255.248177 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:37:35.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:35 smithi084 bash[27323]: audit 1689212255.2494147 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:35.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:35 smithi022 bash[26979]: cluster 1689212254.5098684 mgr.a (mgr.14152) 204 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:35.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:35 smithi022 bash[26979]: audit 1689212255.241934 mon.a (mon.0) 448 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:37:35.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:35 smithi022 bash[26979]: audit 1689212255.248177 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:37:35.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:35 smithi022 bash[26979]: audit 1689212255.2494147 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:35.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:35 smithi154 bash[27744]: cluster 1689212254.5098684 mgr.a (mgr.14152) 204 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:35.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:35 smithi154 bash[27744]: audit 1689212255.241934 mon.a (mon.0) 448 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:37:35.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:35 smithi154 bash[27744]: audit 1689212255.248177 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:37:35.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:35 smithi154 bash[27744]: audit 1689212255.2494147 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:35.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:35 smithi137 bash[27262]: cluster 1689212254.5098684 mgr.a (mgr.14152) 204 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:35.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:35 smithi137 bash[27262]: audit 1689212255.241934 mon.a (mon.0) 448 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:37:35.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:35 smithi137 bash[27262]: audit 1689212255.248177 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:37:35.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:35 smithi137 bash[27262]: audit 1689212255.2494147 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:35.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:35 smithi103 bash[27315]: cluster 1689212254.5098684 mgr.a (mgr.14152) 204 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:35.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:35 smithi103 bash[27315]: audit 1689212255.241934 mon.a (mon.0) 448 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:37:35.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:35 smithi103 bash[27315]: audit 1689212255.248177 mon.a (mon.0) 449 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:37:35.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:35 smithi103 bash[27315]: audit 1689212255.2494147 mon.a (mon.0) 450 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:36.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:36 smithi084 bash[27323]: audit 1689212255.2353055 mgr.a (mgr.14152) 205 : audit 0 from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:37:36.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:36 smithi022 bash[26979]: audit 1689212255.2353055 mgr.a (mgr.14152) 205 : audit 0 from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:37:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:36 smithi154 bash[27744]: audit 1689212255.2353055 mgr.a (mgr.14152) 205 : audit 0 from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:37:36.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:36 smithi137 bash[27262]: audit 1689212255.2353055 mgr.a (mgr.14152) 205 : audit 0 from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:37:36.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:36 smithi103 bash[27315]: audit 1689212255.2353055 mgr.a (mgr.14152) 205 : audit 0 from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:37:37.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:37 smithi084 bash[27323]: cluster 1689212256.5103438 mgr.a (mgr.14152) 206 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:37.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:37 smithi022 bash[26979]: cluster 1689212256.5103438 mgr.a (mgr.14152) 206 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:37.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:37 smithi154 bash[27744]: cluster 1689212256.5103438 mgr.a (mgr.14152) 206 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:37.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:37 smithi137 bash[27262]: cluster 1689212256.5103438 mgr.a (mgr.14152) 206 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:37.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:37 smithi103 bash[27315]: cluster 1689212256.5103438 mgr.a (mgr.14152) 206 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:39.165 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:38 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:37:39.165 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:38 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:37:39.166 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:38 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:37:39.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:39 smithi103 bash[27315]: cluster 1689212258.5108047 mgr.a (mgr.14152) 207 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:39.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:39 smithi084 bash[27323]: cluster 1689212258.5108047 mgr.a (mgr.14152) 207 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:39.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:39 smithi022 bash[26979]: cluster 1689212258.5108047 mgr.a (mgr.14152) 207 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:40.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:39 smithi154 bash[27744]: cluster 1689212258.5108047 mgr.a (mgr.14152) 207 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:40.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:39 smithi137 bash[27262]: cluster 1689212258.5108047 mgr.a (mgr.14152) 207 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:40.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:40 smithi022 bash[40450]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:37:40.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:40 smithi022 bash[40450]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:37:40.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:40 smithi022 bash[40450]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:37:40.416 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:40 smithi022 bash[40450]: --> Failed to activate any OSD(s) 2023-07-13T01:37:41.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:41 smithi022 bash[26979]: cluster 1689212260.5113022 mgr.a (mgr.14152) 208 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:41.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:41 smithi103 bash[27315]: cluster 1689212260.5113022 mgr.a (mgr.14152) 208 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:41.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:41 smithi084 bash[27323]: cluster 1689212260.5113022 mgr.a (mgr.14152) 208 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:42.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:41 smithi154 bash[27744]: cluster 1689212260.5113022 mgr.a (mgr.14152) 208 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:42.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:41 smithi137 bash[27262]: cluster 1689212260.5113022 mgr.a (mgr.14152) 208 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:43.354 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:43 smithi022 bash[40570]: debug 2023-07-13T01:37:43.137+0000 7fe59c5d4700 1 -- 172.21.15.22:0/2019597949 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 621+0+0 (secure 0 0 0) 0x55fb72b1b600 con 0x55fb72b2a800 2023-07-13T01:37:43.354 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:43 smithi022 bash[40570]: debug 2023-07-13T01:37:43.137+0000 7fe59c5d4700 1 -- 172.21.15.22:0/2019597949 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fb72ad4d00 con 0x55fb72b2a800 2023-07-13T01:37:43.354 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:43 smithi022 bash[40570]: debug 2023-07-13T01:37:43.137+0000 7fe5a5759640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:37:43.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:43 smithi022 bash[26979]: cluster 1689212262.5117621 mgr.a (mgr.14152) 209 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:43.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:43 smithi103 bash[27315]: cluster 1689212262.5117621 mgr.a (mgr.14152) 209 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:43.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:43 smithi084 bash[27323]: cluster 1689212262.5117621 mgr.a (mgr.14152) 209 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:44.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:43 smithi154 bash[27744]: cluster 1689212262.5117621 mgr.a (mgr.14152) 209 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:44.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:43 smithi137 bash[27262]: cluster 1689212262.5117621 mgr.a (mgr.14152) 209 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:44.915 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:44 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:37:45.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:45 smithi084 bash[27323]: cluster 1689212264.5121436 mgr.a (mgr.14152) 210 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:45.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:45 smithi022 bash[26979]: cluster 1689212264.5121436 mgr.a (mgr.14152) 210 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:45.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:45 smithi154 bash[27744]: cluster 1689212264.5121436 mgr.a (mgr.14152) 210 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:45.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:45 smithi137 bash[27262]: cluster 1689212264.5121436 mgr.a (mgr.14152) 210 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:45.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:45 smithi103 bash[27315]: cluster 1689212264.5121436 mgr.a (mgr.14152) 210 : cluster 0 pgmap v130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:46.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:46 smithi022 bash[26979]: audit 1689212265.6054986 mon.a (mon.0) 451 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]: dispatch 2023-07-13T01:37:46.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:46 smithi022 bash[26979]: audit 1689212265.6126237 mon.a (mon.0) 452 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]': finished 2023-07-13T01:37:46.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:46 smithi022 bash[26979]: cluster 1689212265.6127172 mon.a (mon.0) 453 : cluster 0 osdmap e6: 2 total, 0 up, 2 in 2023-07-13T01:37:46.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:46 smithi022 bash[26979]: audit 1689212265.6128783 mon.a (mon.0) 454 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:37:46.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:46 smithi022 bash[26979]: audit 1689212265.6132636 mon.a (mon.0) 455 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:37:46.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:46 smithi022 bash[26979]: audit 1689212266.339736 mon.a (mon.0) 456 : audit 0 from='client.? 172.21.15.22:0/976063686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:37:46.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:46 smithi084 bash[27323]: audit 1689212265.6054986 mon.a (mon.0) 451 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]: dispatch 2023-07-13T01:37:46.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:46 smithi084 bash[27323]: audit 1689212265.6126237 mon.a (mon.0) 452 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]': finished 2023-07-13T01:37:46.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:46 smithi084 bash[27323]: cluster 1689212265.6127172 mon.a (mon.0) 453 : cluster 0 osdmap e6: 2 total, 0 up, 2 in 2023-07-13T01:37:46.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:46 smithi084 bash[27323]: audit 1689212265.6128783 mon.a (mon.0) 454 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:37:46.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:46 smithi084 bash[27323]: audit 1689212265.6132636 mon.a (mon.0) 455 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:37:46.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:46 smithi084 bash[27323]: audit 1689212266.339736 mon.a (mon.0) 456 : audit 0 from='client.? 172.21.15.22:0/976063686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:37:46.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:46 smithi154 bash[27744]: audit 1689212265.6054986 mon.a (mon.0) 451 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]: dispatch 2023-07-13T01:37:46.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:46 smithi154 bash[27744]: audit 1689212265.6126237 mon.a (mon.0) 452 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]': finished 2023-07-13T01:37:46.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:46 smithi154 bash[27744]: cluster 1689212265.6127172 mon.a (mon.0) 453 : cluster 0 osdmap e6: 2 total, 0 up, 2 in 2023-07-13T01:37:46.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:46 smithi154 bash[27744]: audit 1689212265.6128783 mon.a (mon.0) 454 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:37:46.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:46 smithi154 bash[27744]: audit 1689212265.6132636 mon.a (mon.0) 455 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:37:46.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:46 smithi154 bash[27744]: audit 1689212266.339736 mon.a (mon.0) 456 : audit 0 from='client.? 172.21.15.22:0/976063686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:37:46.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:46 smithi137 bash[27262]: audit 1689212265.6054986 mon.a (mon.0) 451 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]: dispatch 2023-07-13T01:37:46.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:46 smithi137 bash[27262]: audit 1689212265.6126237 mon.a (mon.0) 452 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]': finished 2023-07-13T01:37:46.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:46 smithi137 bash[27262]: cluster 1689212265.6127172 mon.a (mon.0) 453 : cluster 0 osdmap e6: 2 total, 0 up, 2 in 2023-07-13T01:37:46.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:46 smithi137 bash[27262]: audit 1689212265.6128783 mon.a (mon.0) 454 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:37:46.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:46 smithi137 bash[27262]: audit 1689212265.6132636 mon.a (mon.0) 455 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:37:46.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:46 smithi137 bash[27262]: audit 1689212266.339736 mon.a (mon.0) 456 : audit 0 from='client.? 172.21.15.22:0/976063686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:37:46.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:46 smithi103 bash[27315]: audit 1689212265.6054986 mon.a (mon.0) 451 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]: dispatch 2023-07-13T01:37:46.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:46 smithi103 bash[27315]: audit 1689212265.6126237 mon.a (mon.0) 452 : audit 1 from='client.? 172.21.15.22:0/1199010684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "171e2077-5fb7-41ad-94de-9b60fe82d2d5"}]': finished 2023-07-13T01:37:46.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:46 smithi103 bash[27315]: cluster 1689212265.6127172 mon.a (mon.0) 453 : cluster 0 osdmap e6: 2 total, 0 up, 2 in 2023-07-13T01:37:46.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:46 smithi103 bash[27315]: audit 1689212265.6128783 mon.a (mon.0) 454 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:37:46.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:46 smithi103 bash[27315]: audit 1689212265.6132636 mon.a (mon.0) 455 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:37:46.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:46 smithi103 bash[27315]: audit 1689212266.339736 mon.a (mon.0) 456 : audit 0 from='client.? 172.21.15.22:0/976063686' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:37:47.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:47 smithi084 bash[27323]: cluster 1689212266.5126631 mgr.a (mgr.14152) 211 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:47.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:47 smithi022 bash[26979]: cluster 1689212266.5126631 mgr.a (mgr.14152) 211 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:47.665 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:46 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:37:47.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:47 smithi154 bash[27744]: cluster 1689212266.5126631 mgr.a (mgr.14152) 211 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:47.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:47 smithi137 bash[27262]: cluster 1689212266.5126631 mgr.a (mgr.14152) 211 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:47.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:47 smithi103 bash[27315]: cluster 1689212266.5126631 mgr.a (mgr.14152) 211 : cluster 0 pgmap v132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:49.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:49 smithi103 bash[27315]: cluster 1689212268.5131645 mgr.a (mgr.14152) 212 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:49.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:49 smithi084 bash[27323]: cluster 1689212268.5131645 mgr.a (mgr.14152) 212 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:49 smithi022 bash[26979]: cluster 1689212268.5131645 mgr.a (mgr.14152) 212 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:50.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:49 smithi154 bash[27744]: cluster 1689212268.5131645 mgr.a (mgr.14152) 212 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:50.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:49 smithi137 bash[27262]: cluster 1689212268.5131645 mgr.a (mgr.14152) 212 : cluster 0 pgmap v133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:51.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:51 smithi103 bash[27315]: cluster 1689212270.5137057 mgr.a (mgr.14152) 213 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:51.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:51 smithi084 bash[27323]: cluster 1689212270.5137057 mgr.a (mgr.14152) 213 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:51.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:51 smithi022 bash[26979]: cluster 1689212270.5137057 mgr.a (mgr.14152) 213 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:52.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:51 smithi154 bash[27744]: cluster 1689212270.5137057 mgr.a (mgr.14152) 213 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:52.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:51 smithi137 bash[27262]: cluster 1689212270.5137057 mgr.a (mgr.14152) 213 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:53.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:53 smithi103 bash[27315]: cluster 1689212272.5142174 mgr.a (mgr.14152) 214 : cluster 0 pgmap v135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:53.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:53 smithi084 bash[27323]: cluster 1689212272.5142174 mgr.a (mgr.14152) 214 : cluster 0 pgmap v135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:53.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:53 smithi022 bash[26979]: cluster 1689212272.5142174 mgr.a (mgr.14152) 214 : cluster 0 pgmap v135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:54.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:53 smithi154 bash[27744]: cluster 1689212272.5142174 mgr.a (mgr.14152) 214 : cluster 0 pgmap v135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:54.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:53 smithi137 bash[27262]: cluster 1689212272.5142174 mgr.a (mgr.14152) 214 : cluster 0 pgmap v135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:55.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:55 smithi084 bash[27323]: cluster 1689212274.5147104 mgr.a (mgr.14152) 215 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:55.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:55 smithi022 bash[26979]: cluster 1689212274.5147104 mgr.a (mgr.14152) 215 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:55.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:55 smithi154 bash[27744]: cluster 1689212274.5147104 mgr.a (mgr.14152) 215 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:55.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:55 smithi137 bash[27262]: cluster 1689212274.5147104 mgr.a (mgr.14152) 215 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:55.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:55 smithi103 bash[27315]: cluster 1689212274.5147104 mgr.a (mgr.14152) 215 : cluster 0 pgmap v136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:57.181 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:56 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:37:57.181 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:56 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:37:57.181 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:56 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:37:57.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:57 smithi103 bash[27315]: cluster 1689212276.515171 mgr.a (mgr.14152) 216 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:57.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:57 smithi084 bash[27323]: cluster 1689212276.515171 mgr.a (mgr.14152) 216 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:57.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:57 smithi022 bash[26979]: cluster 1689212276.515171 mgr.a (mgr.14152) 216 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:58.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:57 smithi154 bash[27744]: cluster 1689212276.515171 mgr.a (mgr.14152) 216 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:58.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:57 smithi137 bash[27262]: cluster 1689212276.515171 mgr.a (mgr.14152) 216 : cluster 0 pgmap v137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:58.665 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:58 smithi022 bash[42102]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:37:58.665 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:58 smithi022 bash[42102]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:37:58.665 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:58 smithi022 bash[42102]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:37:58.666 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:37:58 smithi022 bash[42102]: --> Failed to activate any OSD(s) 2023-07-13T01:37:59.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:59 smithi103 bash[27315]: cluster 1689212278.5155473 mgr.a (mgr.14152) 217 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:59.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:59 smithi103 bash[27315]: audit 1689212279.3016074 mon.a (mon.0) 457 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-13T01:37:59.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:37:59 smithi103 bash[27315]: audit 1689212279.3030007 mon.a (mon.0) 458 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:59.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:59 smithi084 bash[27323]: cluster 1689212278.5155473 mgr.a (mgr.14152) 217 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:59.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:59 smithi084 bash[27323]: audit 1689212279.3016074 mon.a (mon.0) 457 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-13T01:37:59.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:37:59 smithi084 bash[27323]: audit 1689212279.3030007 mon.a (mon.0) 458 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:37:59.938 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:59 smithi022 bash[26979]: cluster 1689212278.5155473 mgr.a (mgr.14152) 217 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:37:59.939 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:59 smithi022 bash[26979]: audit 1689212279.3016074 mon.a (mon.0) 457 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-13T01:37:59.939 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:37:59 smithi022 bash[26979]: audit 1689212279.3030007 mon.a (mon.0) 458 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:00.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:59 smithi154 bash[27744]: cluster 1689212278.5155473 mgr.a (mgr.14152) 217 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:00.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:59 smithi154 bash[27744]: audit 1689212279.3016074 mon.a (mon.0) 457 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-13T01:38:00.017 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:37:59 smithi154 bash[27744]: audit 1689212279.3030007 mon.a (mon.0) 458 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:00.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:59 smithi137 bash[27262]: cluster 1689212278.5155473 mgr.a (mgr.14152) 217 : cluster 0 pgmap v138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:00.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:59 smithi137 bash[27262]: audit 1689212279.3016074 mon.a (mon.0) 457 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-13T01:38:00.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:37:59 smithi137 bash[27262]: audit 1689212279.3030007 mon.a (mon.0) 458 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:00.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:00 smithi103 bash[27315]: cephadm 1689212279.3041093 mgr.a (mgr.14152) 218 : cephadm 1 Deploying daemon osd.1 on smithi022 2023-07-13T01:38:00.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:00 smithi022 bash[26979]: cephadm 1689212279.3041093 mgr.a (mgr.14152) 218 : cephadm 1 Deploying daemon osd.1 on smithi022 2023-07-13T01:38:00.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:00 smithi084 bash[27323]: cephadm 1689212279.3041093 mgr.a (mgr.14152) 218 : cephadm 1 Deploying daemon osd.1 on smithi022 2023-07-13T01:38:01.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:00 smithi154 bash[27744]: cephadm 1689212279.3041093 mgr.a (mgr.14152) 218 : cephadm 1 Deploying daemon osd.1 on smithi022 2023-07-13T01:38:01.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:00 smithi137 bash[27262]: cephadm 1689212279.3041093 mgr.a (mgr.14152) 218 : cephadm 1 Deploying daemon osd.1 on smithi022 2023-07-13T01:38:01.213 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:00 smithi022 bash[42287]: debug 2023-07-13T01:38:00.924+0000 7f437b005700 1 -- 172.21.15.22:0/3984700819 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558639912d00 con 0x558639968800 2023-07-13T01:38:01.233 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:00 smithi022 bash[42287]: debug 2023-07-13T01:38:00.928+0000 7f438418a640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:38:01.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:01 smithi103 bash[27315]: cluster 1689212280.5159152 mgr.a (mgr.14152) 219 : cluster 0 pgmap v139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:01.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:01 smithi084 bash[27323]: cluster 1689212280.5159152 mgr.a (mgr.14152) 219 : cluster 0 pgmap v139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:01.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:01 smithi022 bash[26979]: cluster 1689212280.5159152 mgr.a (mgr.14152) 219 : cluster 0 pgmap v139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:02.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:01 smithi154 bash[27744]: cluster 1689212280.5159152 mgr.a (mgr.14152) 219 : cluster 0 pgmap v139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:02.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:01 smithi137 bash[27262]: cluster 1689212280.5159152 mgr.a (mgr.14152) 219 : cluster 0 pgmap v139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:02.315 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:02 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:38:03.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:03 smithi103 bash[27315]: cluster 1689212282.5164044 mgr.a (mgr.14152) 220 : cluster 0 pgmap v140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:03.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:03 smithi084 bash[27323]: cluster 1689212282.5164044 mgr.a (mgr.14152) 220 : cluster 0 pgmap v140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:03.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:03 smithi022 bash[26979]: cluster 1689212282.5164044 mgr.a (mgr.14152) 220 : cluster 0 pgmap v140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:04.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:03 smithi154 bash[27744]: cluster 1689212282.5164044 mgr.a (mgr.14152) 220 : cluster 0 pgmap v140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:04.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:03 smithi137 bash[27262]: cluster 1689212282.5164044 mgr.a (mgr.14152) 220 : cluster 0 pgmap v140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:05.488 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:05 smithi022 bash[26979]: cluster 1689212284.516932 mgr.a (mgr.14152) 221 : cluster 0 pgmap v141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:05.488 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:05 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:38:05.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:05 smithi084 bash[27323]: cluster 1689212284.516932 mgr.a (mgr.14152) 221 : cluster 0 pgmap v141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:05.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:05 smithi154 bash[27744]: cluster 1689212284.516932 mgr.a (mgr.14152) 221 : cluster 0 pgmap v141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:05.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:05 smithi137 bash[27262]: cluster 1689212284.516932 mgr.a (mgr.14152) 221 : cluster 0 pgmap v141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:05.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:05 smithi103 bash[27315]: cluster 1689212284.516932 mgr.a (mgr.14152) 221 : cluster 0 pgmap v141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:06.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:06 smithi022 bash[26979]: audit 1689212285.7382174 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:06.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:06 smithi022 bash[26979]: audit 1689212285.7447665 mon.a (mon.0) 460 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:06 smithi022 bash[26979]: audit 1689212285.7519526 mon.a (mon.0) 461 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:06 smithi154 bash[27744]: audit 1689212285.7382174 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:06.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:06 smithi154 bash[27744]: audit 1689212285.7447665 mon.a (mon.0) 460 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:06 smithi154 bash[27744]: audit 1689212285.7519526 mon.a (mon.0) 461 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:06 smithi137 bash[27262]: audit 1689212285.7382174 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:06.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:06 smithi137 bash[27262]: audit 1689212285.7447665 mon.a (mon.0) 460 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:06 smithi137 bash[27262]: audit 1689212285.7519526 mon.a (mon.0) 461 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:06 smithi103 bash[27315]: audit 1689212285.7382174 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:06.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:06 smithi103 bash[27315]: audit 1689212285.7447665 mon.a (mon.0) 460 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:06 smithi103 bash[27315]: audit 1689212285.7519526 mon.a (mon.0) 461 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:06 smithi084 bash[27323]: audit 1689212285.7382174 mon.a (mon.0) 459 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:06.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:06 smithi084 bash[27323]: audit 1689212285.7447665 mon.a (mon.0) 460 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:06.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:06 smithi084 bash[27323]: audit 1689212285.7519526 mon.a (mon.0) 461 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:07.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:07 smithi022 bash[26979]: cluster 1689212286.5174134 mgr.a (mgr.14152) 222 : cluster 0 pgmap v142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:07.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:07 smithi154 bash[27744]: cluster 1689212286.5174134 mgr.a (mgr.14152) 222 : cluster 0 pgmap v142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:07.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:07 smithi137 bash[27262]: cluster 1689212286.5174134 mgr.a (mgr.14152) 222 : cluster 0 pgmap v142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:07.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:07 smithi103 bash[27315]: cluster 1689212286.5174134 mgr.a (mgr.14152) 222 : cluster 0 pgmap v142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:07.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:07 smithi084 bash[27323]: cluster 1689212286.5174134 mgr.a (mgr.14152) 222 : cluster 0 pgmap v142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:09.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:09 smithi103 bash[27315]: cluster 1689212288.5179012 mgr.a (mgr.14152) 223 : cluster 0 pgmap v143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:09.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:09 smithi084 bash[27323]: cluster 1689212288.5179012 mgr.a (mgr.14152) 223 : cluster 0 pgmap v143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:09.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:09 smithi022 bash[26979]: cluster 1689212288.5179012 mgr.a (mgr.14152) 223 : cluster 0 pgmap v143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:10.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:09 smithi154 bash[27744]: cluster 1689212288.5179012 mgr.a (mgr.14152) 223 : cluster 0 pgmap v143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:10.065 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:09 smithi137 bash[27262]: cluster 1689212288.5179012 mgr.a (mgr.14152) 223 : cluster 0 pgmap v143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:11.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:11 smithi022 bash[26979]: cluster 1689212290.5183148 mgr.a (mgr.14152) 224 : cluster 0 pgmap v144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:11.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:11 smithi022 bash[26979]: audit 1689212291.491841 mon.a (mon.0) 462 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:11.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:11 smithi022 bash[26979]: audit 1689212291.5013065 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:11.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:11 smithi103 bash[27315]: cluster 1689212290.5183148 mgr.a (mgr.14152) 224 : cluster 0 pgmap v144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:11.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:11 smithi103 bash[27315]: audit 1689212291.491841 mon.a (mon.0) 462 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:11.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:11 smithi103 bash[27315]: audit 1689212291.5013065 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:11.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:11 smithi084 bash[27323]: cluster 1689212290.5183148 mgr.a (mgr.14152) 224 : cluster 0 pgmap v144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:11.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:11 smithi084 bash[27323]: audit 1689212291.491841 mon.a (mon.0) 462 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:11.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:11 smithi084 bash[27323]: audit 1689212291.5013065 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:11 smithi154 bash[27744]: cluster 1689212290.5183148 mgr.a (mgr.14152) 224 : cluster 0 pgmap v144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:11 smithi154 bash[27744]: audit 1689212291.491841 mon.a (mon.0) 462 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:11 smithi154 bash[27744]: audit 1689212291.5013065 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:11 smithi137 bash[27262]: cluster 1689212290.5183148 mgr.a (mgr.14152) 224 : cluster 0 pgmap v144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:11 smithi137 bash[27262]: audit 1689212291.491841 mon.a (mon.0) 462 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:11 smithi137 bash[27262]: audit 1689212291.5013065 mon.a (mon.0) 463 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:12 smithi022 bash[26979]: audit 1689212291.97314 mon.a (mon.0) 464 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:12.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:12 smithi022 bash[26979]: audit 1689212291.9747286 mon.a (mon.0) 465 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:12.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:12 smithi022 bash[26979]: cluster 1689212291.9775345 mgr.a (mgr.14152) 225 : cluster 0 pgmap v145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:12 smithi022 bash[26979]: cluster 1689212291.9777932 mgr.a (mgr.14152) 226 : cluster 0 pgmap v146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:12 smithi022 bash[26979]: audit 1689212291.9835207 mon.a (mon.0) 466 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:12 smithi103 bash[27315]: audit 1689212291.97314 mon.a (mon.0) 464 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:12.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:12 smithi103 bash[27315]: audit 1689212291.9747286 mon.a (mon.0) 465 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:12.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:12 smithi103 bash[27315]: cluster 1689212291.9775345 mgr.a (mgr.14152) 225 : cluster 0 pgmap v145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:12 smithi103 bash[27315]: cluster 1689212291.9777932 mgr.a (mgr.14152) 226 : cluster 0 pgmap v146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:12 smithi103 bash[27315]: audit 1689212291.9835207 mon.a (mon.0) 466 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:12.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:12 smithi084 bash[27323]: audit 1689212291.97314 mon.a (mon.0) 464 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:12.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:12 smithi084 bash[27323]: audit 1689212291.9747286 mon.a (mon.0) 465 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:12.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:12 smithi084 bash[27323]: cluster 1689212291.9775345 mgr.a (mgr.14152) 225 : cluster 0 pgmap v145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:12 smithi084 bash[27323]: cluster 1689212291.9777932 mgr.a (mgr.14152) 226 : cluster 0 pgmap v146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:12.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:12 smithi084 bash[27323]: audit 1689212291.9835207 mon.a (mon.0) 466 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:13.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:12 smithi154 bash[27744]: audit 1689212291.97314 mon.a (mon.0) 464 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:13.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:12 smithi154 bash[27744]: audit 1689212291.9747286 mon.a (mon.0) 465 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:13.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:12 smithi154 bash[27744]: cluster 1689212291.9775345 mgr.a (mgr.14152) 225 : cluster 0 pgmap v145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:13.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:12 smithi154 bash[27744]: cluster 1689212291.9777932 mgr.a (mgr.14152) 226 : cluster 0 pgmap v146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:13.017 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:12 smithi154 bash[27744]: audit 1689212291.9835207 mon.a (mon.0) 466 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:13.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:12 smithi137 bash[27262]: audit 1689212291.97314 mon.a (mon.0) 464 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:13.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:12 smithi137 bash[27262]: audit 1689212291.9747286 mon.a (mon.0) 465 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:13.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:12 smithi137 bash[27262]: cluster 1689212291.9775345 mgr.a (mgr.14152) 225 : cluster 0 pgmap v145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:13.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:12 smithi137 bash[27262]: cluster 1689212291.9777932 mgr.a (mgr.14152) 226 : cluster 0 pgmap v146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:13.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:12 smithi137 bash[27262]: audit 1689212291.9835207 mon.a (mon.0) 466 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:13.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:13 smithi103 bash[27315]: cluster 1689212292.5762885 mon.a (mon.0) 467 : cluster 3 Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:38:13.877 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:13 smithi022 bash[26979]: cluster 1689212292.5762885 mon.a (mon.0) 467 : cluster 3 Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:38:13.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:13 smithi084 bash[27323]: cluster 1689212292.5762885 mon.a (mon.0) 467 : cluster 3 Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:38:14.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:13 smithi154 bash[27744]: cluster 1689212292.5762885 mon.a (mon.0) 467 : cluster 3 Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:38:14.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:13 smithi137 bash[27262]: cluster 1689212292.5762885 mon.a (mon.0) 467 : cluster 3 Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:38:14.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:14 smithi103 bash[27315]: cluster 1689212293.9782813 mgr.a (mgr.14152) 227 : cluster 0 pgmap v147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:14.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:14 smithi084 bash[27323]: cluster 1689212293.9782813 mgr.a (mgr.14152) 227 : cluster 0 pgmap v147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:14.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:14 smithi022 bash[26979]: cluster 1689212293.9782813 mgr.a (mgr.14152) 227 : cluster 0 pgmap v147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:15.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:14 smithi154 bash[27744]: cluster 1689212293.9782813 mgr.a (mgr.14152) 227 : cluster 0 pgmap v147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:15.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:14 smithi137 bash[27262]: cluster 1689212293.9782813 mgr.a (mgr.14152) 227 : cluster 0 pgmap v147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:15.180 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 1 on host 'smithi022' 2023-07-13T01:38:15.598 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:15 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:38:15.599 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:15 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:15.599 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:15 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:16.232 DEBUG:teuthology.orchestra.run.smithi022:osd.1> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service 2023-07-13T01:38:16.234 INFO:tasks.cephadm:Deploying osd.2 on smithi022 with /dev/vg_nvme/lv_2... 2023-07-13T01:38:16.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-13T01:38:16.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:16 smithi084 bash[27323]: audit 1689212295.1275978 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:16 smithi084 bash[27323]: audit 1689212295.1349063 mon.a (mon.0) 469 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.402 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:16 smithi084 bash[27323]: audit 1689212295.1695344 mon.a (mon.0) 470 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:16.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:16 smithi022 bash[26979]: audit 1689212295.1275978 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:16 smithi022 bash[26979]: audit 1689212295.1349063 mon.a (mon.0) 469 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.416 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:16 smithi022 bash[26979]: audit 1689212295.1695344 mon.a (mon.0) 470 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:16.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:16 smithi154 bash[27744]: audit 1689212295.1275978 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.516 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:16 smithi154 bash[27744]: audit 1689212295.1349063 mon.a (mon.0) 469 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.516 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:16 smithi154 bash[27744]: audit 1689212295.1695344 mon.a (mon.0) 470 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:16.563 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:16 smithi137 bash[27262]: audit 1689212295.1275978 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.563 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:16 smithi137 bash[27262]: audit 1689212295.1349063 mon.a (mon.0) 469 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.563 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:16 smithi137 bash[27262]: audit 1689212295.1695344 mon.a (mon.0) 470 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:16.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:16 smithi103 bash[27315]: audit 1689212295.1275978 mon.a (mon.0) 468 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:16 smithi103 bash[27315]: audit 1689212295.1349063 mon.a (mon.0) 469 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:16.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:16 smithi103 bash[27315]: audit 1689212295.1695344 mon.a (mon.0) 470 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:38:16.787 INFO:journalctl@ceph.osd.1.smithi022.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:38:17.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:17 smithi084 bash[27323]: cluster 1689212295.978718 mgr.a (mgr.14152) 228 : cluster 0 pgmap v148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:17.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:17 smithi022 bash[26979]: cluster 1689212295.978718 mgr.a (mgr.14152) 228 : cluster 0 pgmap v148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:17.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:17 smithi022 bash[43635]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:17.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:17 smithi022 bash[43635]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:17.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:17 smithi022 bash[43635]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:38:17.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:17 smithi022 bash[43635]: --> Failed to activate any OSD(s) 2023-07-13T01:38:17.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:17 smithi154 bash[27744]: cluster 1689212295.978718 mgr.a (mgr.14152) 228 : cluster 0 pgmap v148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:17.562 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:17 smithi137 bash[27262]: cluster 1689212295.978718 mgr.a (mgr.14152) 228 : cluster 0 pgmap v148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:17.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:17 smithi103 bash[27315]: cluster 1689212295.978718 mgr.a (mgr.14152) 228 : cluster 0 pgmap v148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:18.994 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:18 smithi022 bash[43782]: debug 2023-07-13T01:38:18.804+0000 7f5ff76e3700 1 -- 172.21.15.22:0/4010525186 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c87f4cd00 con 0x556c87fa2c00 2023-07-13T01:38:18.994 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:18 smithi022 bash[43782]: debug 2023-07-13T01:38:18.804+0000 7f6000868640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:38:19.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:19 smithi084 bash[27323]: cluster 1689212297.9791565 mgr.a (mgr.14152) 229 : cluster 0 pgmap v149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:19.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:19 smithi022 bash[26979]: cluster 1689212297.9791565 mgr.a (mgr.14152) 229 : cluster 0 pgmap v149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:19.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:19 smithi154 bash[27744]: cluster 1689212297.9791565 mgr.a (mgr.14152) 229 : cluster 0 pgmap v149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:19.562 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:19 smithi137 bash[27262]: cluster 1689212297.9791565 mgr.a (mgr.14152) 229 : cluster 0 pgmap v149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:19.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:19 smithi103 bash[27315]: cluster 1689212297.9791565 mgr.a (mgr.14152) 229 : cluster 0 pgmap v149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:19.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:19 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:38:20.308 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:38:20.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:20 smithi022 bash[26979]: cluster 1689212299.9796097 mgr.a (mgr.14152) 230 : cluster 0 pgmap v150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:20.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:20 smithi154 bash[27744]: cluster 1689212299.9796097 mgr.a (mgr.14152) 230 : cluster 0 pgmap v150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:20.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:20 smithi137 bash[27262]: cluster 1689212299.9796097 mgr.a (mgr.14152) 230 : cluster 0 pgmap v150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:20.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:20 smithi103 bash[27315]: cluster 1689212299.9796097 mgr.a (mgr.14152) 230 : cluster 0 pgmap v150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:20.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:20 smithi084 bash[27323]: cluster 1689212299.9796097 mgr.a (mgr.14152) 230 : cluster 0 pgmap v150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:22.664 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:22 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:38:22.665 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:22 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:22.665 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:22 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:22.943 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:22 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:38:23.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:23 smithi022 bash[26979]: cluster 1689212301.9800677 mgr.a (mgr.14152) 231 : cluster 0 pgmap v151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:23.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:23 smithi137 bash[27262]: cluster 1689212301.9800677 mgr.a (mgr.14152) 231 : cluster 0 pgmap v151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:23.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:23 smithi103 bash[27315]: cluster 1689212301.9800677 mgr.a (mgr.14152) 231 : cluster 0 pgmap v151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:23.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:23 smithi084 bash[27323]: cluster 1689212301.9800677 mgr.a (mgr.14152) 231 : cluster 0 pgmap v151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:23.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:23 smithi154 bash[27744]: cluster 1689212301.9800677 mgr.a (mgr.14152) 231 : cluster 0 pgmap v151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:25.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:25 smithi137 bash[27262]: cluster 1689212303.9805322 mgr.a (mgr.14152) 232 : cluster 0 pgmap v152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:25.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:25 smithi103 bash[27315]: cluster 1689212303.9805322 mgr.a (mgr.14152) 232 : cluster 0 pgmap v152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:25.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:25 smithi084 bash[27323]: cluster 1689212303.9805322 mgr.a (mgr.14152) 232 : cluster 0 pgmap v152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:25.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:25 smithi022 bash[26979]: cluster 1689212303.9805322 mgr.a (mgr.14152) 232 : cluster 0 pgmap v152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:25.415 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:25 smithi022 bash[44100]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:25.415 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:25 smithi022 bash[44100]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:25.415 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:25 smithi022 bash[44100]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:38:25.416 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:25 smithi022 bash[44100]: --> Failed to activate any OSD(s) 2023-07-13T01:38:25.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:25 smithi154 bash[27744]: cluster 1689212303.9805322 mgr.a (mgr.14152) 232 : cluster 0 pgmap v152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:27.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:27 smithi137 bash[27262]: cluster 1689212305.9809592 mgr.a (mgr.14152) 233 : cluster 0 pgmap v153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:27.319 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-13T01:38:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-13T01:38:27.320 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10+0 records in 2023-07-13T01:38:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:10+0 records out 2023-07-13T01:38:27.320 INFO:teuthology.orchestra.run.smithi022.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0149613 s, 701 MB/s 2023-07-13T01:38:27.320 INFO:teuthology.orchestra.run.smithi022.stderr:--> Zapping successful for: 2023-07-13T01:38:27.361 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:27 smithi103 bash[27315]: cluster 1689212305.9809592 mgr.a (mgr.14152) 233 : cluster 0 pgmap v153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:27.380 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:27 smithi022 bash[26979]: cluster 1689212305.9809592 mgr.a (mgr.14152) 233 : cluster 0 pgmap v153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:27.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:27 smithi084 bash[27323]: cluster 1689212305.9809592 mgr.a (mgr.14152) 233 : cluster 0 pgmap v153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:27.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:27 smithi154 bash[27744]: cluster 1689212305.9809592 mgr.a (mgr.14152) 233 : cluster 0 pgmap v153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:28.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2023-07-13T01:38:28.595 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:28 smithi022 bash[44390]: debug 2023-07-13T01:38:28.563+0000 7f7d915fe700 1 -- 172.21.15.22:0/1022821666 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562944162d00 con 0x5629441b9000 2023-07-13T01:38:28.595 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:28 smithi022 bash[44390]: debug 2023-07-13T01:38:28.563+0000 7f7d9a783640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:38:29.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: cluster 1689212307.9814134 mgr.a (mgr.14152) 234 : cluster 0 pgmap v154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:29.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5334141 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5433366 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5445542 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5456808 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5552683 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.314 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5566928 mon.a (mon.0) 476 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:29.314 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.5577533 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:29.314 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:29 smithi137 bash[27262]: audit 1689212308.566322 mon.a (mon.0) 478 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: cluster 1689212307.9814134 mgr.a (mgr.14152) 234 : cluster 0 pgmap v154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:29.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5334141 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5433366 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5445542 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5456808 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.363 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5552683 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.363 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5566928 mon.a (mon.0) 476 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:29.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.5577533 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:29.364 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:29 smithi103 bash[27315]: audit 1689212308.566322 mon.a (mon.0) 478 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: cluster 1689212307.9814134 mgr.a (mgr.14152) 234 : cluster 0 pgmap v154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:29.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5334141 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.402 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5433366 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.402 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5445542 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.402 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5456808 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.403 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5552683 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.403 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5566928 mon.a (mon.0) 476 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:29.403 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.5577533 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:29.404 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:29 smithi084 bash[27323]: audit 1689212308.566322 mon.a (mon.0) 478 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: cluster 1689212307.9814134 mgr.a (mgr.14152) 234 : cluster 0 pgmap v154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:29.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5334141 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5433366 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5445542 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5456808 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5552683 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5566928 mon.a (mon.0) 476 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:29.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.5577533 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:29.416 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:29 smithi022 bash[26979]: audit 1689212308.566322 mon.a (mon.0) 478 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.416 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:29 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:38:29.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: cluster 1689212307.9814134 mgr.a (mgr.14152) 234 : cluster 0 pgmap v154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:29.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5334141 mon.a (mon.0) 471 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5433366 mon.a (mon.0) 472 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5445542 mon.a (mon.0) 473 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5456808 mon.a (mon.0) 474 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:38:29.516 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5552683 mon.a (mon.0) 475 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:29.516 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5566928 mon.a (mon.0) 476 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:29.516 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.5577533 mon.a (mon.0) 477 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:38:29.516 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:29 smithi154 bash[27744]: audit 1689212308.566322 mon.a (mon.0) 478 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:38:30.310 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:30 smithi022 bash[26979]: cephadm 1689212308.5270267 mgr.a (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:38:30.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:30 smithi022 bash[26979]: cephadm 1689212308.546466 mgr.a (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi022 to 8634M 2023-07-13T01:38:30.311 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:30 smithi022 bash[26979]: cluster 1689212308.5602627 mgr.a (mgr.14152) 237 : cluster 0 pgmap v155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.312 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:30 smithi022 bash[26979]: cluster 1689212308.5605474 mgr.a (mgr.14152) 238 : cluster 0 pgmap v156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:30 smithi137 bash[27262]: cephadm 1689212308.5270267 mgr.a (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:38:30.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:30 smithi137 bash[27262]: cephadm 1689212308.546466 mgr.a (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi022 to 8634M 2023-07-13T01:38:30.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:30 smithi137 bash[27262]: cluster 1689212308.5602627 mgr.a (mgr.14152) 237 : cluster 0 pgmap v155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.313 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:30 smithi137 bash[27262]: cluster 1689212308.5605474 mgr.a (mgr.14152) 238 : cluster 0 pgmap v156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:30 smithi103 bash[27315]: cephadm 1689212308.5270267 mgr.a (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:38:30.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:30 smithi103 bash[27315]: cephadm 1689212308.546466 mgr.a (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi022 to 8634M 2023-07-13T01:38:30.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:30 smithi103 bash[27315]: cluster 1689212308.5602627 mgr.a (mgr.14152) 237 : cluster 0 pgmap v155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.362 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:30 smithi103 bash[27315]: cluster 1689212308.5605474 mgr.a (mgr.14152) 238 : cluster 0 pgmap v156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:30 smithi084 bash[27323]: cephadm 1689212308.5270267 mgr.a (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:38:30.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:30 smithi084 bash[27323]: cephadm 1689212308.546466 mgr.a (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi022 to 8634M 2023-07-13T01:38:30.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:30 smithi084 bash[27323]: cluster 1689212308.5602627 mgr.a (mgr.14152) 237 : cluster 0 pgmap v155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:30 smithi084 bash[27323]: cluster 1689212308.5605474 mgr.a (mgr.14152) 238 : cluster 0 pgmap v156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:30 smithi154 bash[27744]: cephadm 1689212308.5270267 mgr.a (mgr.14152) 235 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:38:30.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:30 smithi154 bash[27744]: cephadm 1689212308.546466 mgr.a (mgr.14152) 236 : cephadm 1 Adjusting osd_memory_target on smithi022 to 8634M 2023-07-13T01:38:30.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:30 smithi154 bash[27744]: cluster 1689212308.5602627 mgr.a (mgr.14152) 237 : cluster 0 pgmap v155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:30.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:30 smithi154 bash[27744]: cluster 1689212308.5605474 mgr.a (mgr.14152) 238 : cluster 0 pgmap v156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:31.664 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:31 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:38:32.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:32 smithi137 bash[27262]: cluster 1689212310.5608888 mgr.a (mgr.14152) 239 : cluster 0 pgmap v157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:32.361 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:32 smithi103 bash[27315]: cluster 1689212310.5608888 mgr.a (mgr.14152) 239 : cluster 0 pgmap v157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:32.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:32 smithi084 bash[27323]: cluster 1689212310.5608888 mgr.a (mgr.14152) 239 : cluster 0 pgmap v157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:32.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:32 smithi022 bash[26979]: cluster 1689212310.5608888 mgr.a (mgr.14152) 239 : cluster 0 pgmap v157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:32.515 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:32 smithi154 bash[27744]: cluster 1689212310.5608888 mgr.a (mgr.14152) 239 : cluster 0 pgmap v157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:33.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:32 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:38:33.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:32 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:33.415 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:32 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:34.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:34 smithi022 bash[26979]: cluster 1689212312.5613027 mgr.a (mgr.14152) 240 : cluster 0 pgmap v158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:34.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:34 smithi137 bash[27262]: cluster 1689212312.5613027 mgr.a (mgr.14152) 240 : cluster 0 pgmap v158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:34.361 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:34 smithi103 bash[27315]: cluster 1689212312.5613027 mgr.a (mgr.14152) 240 : cluster 0 pgmap v158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:34.375 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:38:34.401 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:34 smithi084 bash[27323]: cluster 1689212312.5613027 mgr.a (mgr.14152) 240 : cluster 0 pgmap v158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:34.518 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:34 smithi154 bash[27744]: cluster 1689212312.5613027 mgr.a (mgr.14152) 240 : cluster 0 pgmap v158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:34.698 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:34 smithi022 bash[45450]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:34.698 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:34 smithi022 bash[45450]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:34.698 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:34 smithi022 bash[45450]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:38:34.698 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:34 smithi022 bash[45450]: --> Failed to activate any OSD(s) 2023-07-13T01:38:35.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:35 smithi022 bash[26979]: cluster 1689212314.5617673 mgr.a (mgr.14152) 241 : cluster 0 pgmap v159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:35.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:35 smithi154 bash[27744]: cluster 1689212314.5617673 mgr.a (mgr.14152) 241 : cluster 0 pgmap v159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:35.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:35 smithi137 bash[27262]: cluster 1689212314.5617673 mgr.a (mgr.14152) 241 : cluster 0 pgmap v159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:35.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:35 smithi103 bash[27315]: cluster 1689212314.5617673 mgr.a (mgr.14152) 241 : cluster 0 pgmap v159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:35.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:35 smithi084 bash[27323]: cluster 1689212314.5617673 mgr.a (mgr.14152) 241 : cluster 0 pgmap v159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:36.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:36 smithi022 bash[45564]: debug 2023-07-13T01:38:36.755+0000 7f3c7687a700 1 -- 172.21.15.22:0/2661726808 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558046ac6d00 con 0x558046b1c800 2023-07-13T01:38:36.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:36 smithi022 bash[45564]: debug 2023-07-13T01:38:36.759+0000 7f3c7f9ff640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:38:37.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:37 smithi084 bash[27323]: cluster 1689212316.562194 mgr.a (mgr.14152) 242 : cluster 0 pgmap v160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:37.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:37 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:38:37.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:37 smithi022 bash[26979]: cluster 1689212316.562194 mgr.a (mgr.14152) 242 : cluster 0 pgmap v160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:38.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:37 smithi154 bash[27744]: cluster 1689212316.562194 mgr.a (mgr.14152) 242 : cluster 0 pgmap v160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:38.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:37 smithi137 bash[27262]: cluster 1689212316.562194 mgr.a (mgr.14152) 242 : cluster 0 pgmap v160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:38.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:37 smithi103 bash[27315]: cluster 1689212316.562194 mgr.a (mgr.14152) 242 : cluster 0 pgmap v160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:39.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:39 smithi084 bash[27323]: cluster 1689212318.5624986 mgr.a (mgr.14152) 243 : cluster 0 pgmap v161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:39.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:39 smithi084 bash[27323]: audit 1689212318.8039436 mgr.a (mgr.14152) 244 : audit 0 from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:38:39.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:39 smithi084 bash[27323]: audit 1689212318.8088136 mon.a (mon.0) 479 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:38:39.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:39 smithi084 bash[27323]: audit 1689212318.8116953 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:38:39.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:39 smithi084 bash[27323]: audit 1689212318.8125594 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:39.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:39 smithi022 bash[26979]: cluster 1689212318.5624986 mgr.a (mgr.14152) 243 : cluster 0 pgmap v161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:39.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:39 smithi022 bash[26979]: audit 1689212318.8039436 mgr.a (mgr.14152) 244 : audit 0 from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:38:39.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:39 smithi022 bash[26979]: audit 1689212318.8088136 mon.a (mon.0) 479 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:38:39.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:39 smithi022 bash[26979]: audit 1689212318.8116953 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:38:39.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:39 smithi022 bash[26979]: audit 1689212318.8125594 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:40.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:39 smithi154 bash[27744]: cluster 1689212318.5624986 mgr.a (mgr.14152) 243 : cluster 0 pgmap v161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:40.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:39 smithi154 bash[27744]: audit 1689212318.8039436 mgr.a (mgr.14152) 244 : audit 0 from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:38:40.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:39 smithi154 bash[27744]: audit 1689212318.8088136 mon.a (mon.0) 479 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:38:40.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:39 smithi154 bash[27744]: audit 1689212318.8116953 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:38:40.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:39 smithi154 bash[27744]: audit 1689212318.8125594 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:40.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:39 smithi137 bash[27262]: cluster 1689212318.5624986 mgr.a (mgr.14152) 243 : cluster 0 pgmap v161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:40.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:39 smithi137 bash[27262]: audit 1689212318.8039436 mgr.a (mgr.14152) 244 : audit 0 from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:38:40.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:39 smithi137 bash[27262]: audit 1689212318.8088136 mon.a (mon.0) 479 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:38:40.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:39 smithi137 bash[27262]: audit 1689212318.8116953 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:38:40.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:39 smithi137 bash[27262]: audit 1689212318.8125594 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:40.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:39 smithi103 bash[27315]: cluster 1689212318.5624986 mgr.a (mgr.14152) 243 : cluster 0 pgmap v161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:40.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:39 smithi103 bash[27315]: audit 1689212318.8039436 mgr.a (mgr.14152) 244 : audit 0 from='client.14325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:38:40.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:39 smithi103 bash[27315]: audit 1689212318.8088136 mon.a (mon.0) 479 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:38:40.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:39 smithi103 bash[27315]: audit 1689212318.8116953 mon.a (mon.0) 480 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:38:40.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:39 smithi103 bash[27315]: audit 1689212318.8125594 mon.a (mon.0) 481 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:38:40.664 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:40 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:38:41.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:41 smithi084 bash[27323]: cluster 1689212320.5628645 mgr.a (mgr.14152) 245 : cluster 0 pgmap v162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:41.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:41 smithi022 bash[26979]: cluster 1689212320.5628645 mgr.a (mgr.14152) 245 : cluster 0 pgmap v162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:41.914 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:41 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:38:41.915 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:41 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:41.915 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:41 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:42.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:41 smithi154 bash[27744]: cluster 1689212320.5628645 mgr.a (mgr.14152) 245 : cluster 0 pgmap v162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:42.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:41 smithi137 bash[27262]: cluster 1689212320.5628645 mgr.a (mgr.14152) 245 : cluster 0 pgmap v162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:42.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:41 smithi103 bash[27315]: cluster 1689212320.5628645 mgr.a (mgr.14152) 245 : cluster 0 pgmap v162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:43.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:42 smithi022 bash[45989]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:43.165 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:42 smithi022 bash[45989]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:43.165 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:42 smithi022 bash[45989]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:38:43.165 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:42 smithi022 bash[45989]: --> Failed to activate any OSD(s) 2023-07-13T01:38:43.879 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:43 smithi022 bash[26979]: cluster 1689212322.563272 mgr.a (mgr.14152) 246 : cluster 0 pgmap v163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:43.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:43 smithi084 bash[27323]: cluster 1689212322.563272 mgr.a (mgr.14152) 246 : cluster 0 pgmap v163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:44.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:43 smithi154 bash[27744]: cluster 1689212322.563272 mgr.a (mgr.14152) 246 : cluster 0 pgmap v163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:44.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:43 smithi137 bash[27262]: cluster 1689212322.563272 mgr.a (mgr.14152) 246 : cluster 0 pgmap v163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:44.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:43 smithi103 bash[27315]: cluster 1689212322.563272 mgr.a (mgr.14152) 246 : cluster 0 pgmap v163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:45.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:44 smithi022 bash[46112]: debug 2023-07-13T01:38:44.967+0000 7f6326be4700 1 -- 172.21.15.22:0/2715279396 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557f8ab6cd00 con 0x557f8abc3000 2023-07-13T01:38:45.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:44 smithi022 bash[46112]: debug 2023-07-13T01:38:44.967+0000 7f632fd69640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:38:45.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:45 smithi022 bash[26979]: cluster 1689212324.5637205 mgr.a (mgr.14152) 247 : cluster 0 pgmap v164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:45.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:45 smithi154 bash[27744]: cluster 1689212324.5637205 mgr.a (mgr.14152) 247 : cluster 0 pgmap v164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:45.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:45 smithi137 bash[27262]: cluster 1689212324.5637205 mgr.a (mgr.14152) 247 : cluster 0 pgmap v164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:45.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:45 smithi103 bash[27315]: cluster 1689212324.5637205 mgr.a (mgr.14152) 247 : cluster 0 pgmap v164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:45.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:45 smithi084 bash[27323]: cluster 1689212324.5637205 mgr.a (mgr.14152) 247 : cluster 0 pgmap v164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:46.414 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:46 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:38:47.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:47 smithi084 bash[27323]: cluster 1689212326.5641768 mgr.a (mgr.14152) 248 : cluster 0 pgmap v165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:47.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:47 smithi022 bash[26979]: cluster 1689212326.5641768 mgr.a (mgr.14152) 248 : cluster 0 pgmap v165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:48.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:47 smithi154 bash[27744]: cluster 1689212326.5641768 mgr.a (mgr.14152) 248 : cluster 0 pgmap v165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:48.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:47 smithi137 bash[27262]: cluster 1689212326.5641768 mgr.a (mgr.14152) 248 : cluster 0 pgmap v165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:48.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:47 smithi103 bash[27315]: cluster 1689212326.5641768 mgr.a (mgr.14152) 248 : cluster 0 pgmap v165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:49.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:48 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:38:49.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: cluster 1689212328.5646627 mgr.a (mgr.14152) 249 : cluster 0 pgmap v166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:49.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: audit 1689212328.7562172 mon.a (mon.0) 482 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]: dispatch 2023-07-13T01:38:49.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: audit 1689212328.7626004 mon.a (mon.0) 483 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]': finished 2023-07-13T01:38:49.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: cluster 1689212328.7626634 mon.a (mon.0) 484 : cluster 0 osdmap e7: 3 total, 0 up, 3 in 2023-07-13T01:38:49.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: audit 1689212328.762913 mon.a (mon.0) 485 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:38:49.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: audit 1689212328.7636433 mon.a (mon.0) 486 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:38:49.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: audit 1689212328.76408 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:38:49.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:49 smithi084 bash[27323]: audit 1689212329.4938715 mon.a (mon.0) 488 : audit 0 from='client.? 172.21.15.22:0/1350746450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:38:49.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: cluster 1689212328.5646627 mgr.a (mgr.14152) 249 : cluster 0 pgmap v166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:49.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: audit 1689212328.7562172 mon.a (mon.0) 482 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]: dispatch 2023-07-13T01:38:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: audit 1689212328.7626004 mon.a (mon.0) 483 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]': finished 2023-07-13T01:38:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: cluster 1689212328.7626634 mon.a (mon.0) 484 : cluster 0 osdmap e7: 3 total, 0 up, 3 in 2023-07-13T01:38:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: audit 1689212328.762913 mon.a (mon.0) 485 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:38:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: audit 1689212328.7636433 mon.a (mon.0) 486 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:38:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: audit 1689212328.76408 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:38:49.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:49 smithi022 bash[26979]: audit 1689212329.4938715 mon.a (mon.0) 488 : audit 0 from='client.? 172.21.15.22:0/1350746450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:38:50.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: cluster 1689212328.5646627 mgr.a (mgr.14152) 249 : cluster 0 pgmap v166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:50.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: audit 1689212328.7562172 mon.a (mon.0) 482 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]: dispatch 2023-07-13T01:38:50.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: audit 1689212328.7626004 mon.a (mon.0) 483 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]': finished 2023-07-13T01:38:50.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: cluster 1689212328.7626634 mon.a (mon.0) 484 : cluster 0 osdmap e7: 3 total, 0 up, 3 in 2023-07-13T01:38:50.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: audit 1689212328.762913 mon.a (mon.0) 485 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:38:50.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: audit 1689212328.7636433 mon.a (mon.0) 486 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:38:50.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: audit 1689212328.76408 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:38:50.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:49 smithi154 bash[27744]: audit 1689212329.4938715 mon.a (mon.0) 488 : audit 0 from='client.? 172.21.15.22:0/1350746450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:38:50.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: cluster 1689212328.5646627 mgr.a (mgr.14152) 249 : cluster 0 pgmap v166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:50.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: audit 1689212328.7562172 mon.a (mon.0) 482 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]: dispatch 2023-07-13T01:38:50.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: audit 1689212328.7626004 mon.a (mon.0) 483 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]': finished 2023-07-13T01:38:50.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: cluster 1689212328.7626634 mon.a (mon.0) 484 : cluster 0 osdmap e7: 3 total, 0 up, 3 in 2023-07-13T01:38:50.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: audit 1689212328.762913 mon.a (mon.0) 485 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:38:50.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: audit 1689212328.7636433 mon.a (mon.0) 486 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:38:50.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: audit 1689212328.76408 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:38:50.064 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:49 smithi137 bash[27262]: audit 1689212329.4938715 mon.a (mon.0) 488 : audit 0 from='client.? 172.21.15.22:0/1350746450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:38:50.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: cluster 1689212328.5646627 mgr.a (mgr.14152) 249 : cluster 0 pgmap v166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:50.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: audit 1689212328.7562172 mon.a (mon.0) 482 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]: dispatch 2023-07-13T01:38:50.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: audit 1689212328.7626004 mon.a (mon.0) 483 : audit 1 from='client.? 172.21.15.22:0/4184517474' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43688c8c-1c30-4835-9e21-98dd396782ae"}]': finished 2023-07-13T01:38:50.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: cluster 1689212328.7626634 mon.a (mon.0) 484 : cluster 0 osdmap e7: 3 total, 0 up, 3 in 2023-07-13T01:38:50.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: audit 1689212328.762913 mon.a (mon.0) 485 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:38:50.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: audit 1689212328.7636433 mon.a (mon.0) 486 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:38:50.113 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: audit 1689212328.76408 mon.a (mon.0) 487 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:38:50.113 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:49 smithi103 bash[27315]: audit 1689212329.4938715 mon.a (mon.0) 488 : audit 0 from='client.? 172.21.15.22:0/1350746450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:38:50.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:50 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:38:50.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:50 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:50.915 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:50 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:51.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:51 smithi022 bash[26979]: cluster 1689212330.5651238 mgr.a (mgr.14152) 250 : cluster 0 pgmap v168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:51.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:51 smithi084 bash[27323]: cluster 1689212330.5651238 mgr.a (mgr.14152) 250 : cluster 0 pgmap v168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:52.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:51 smithi154 bash[27744]: cluster 1689212330.5651238 mgr.a (mgr.14152) 250 : cluster 0 pgmap v168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:52.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:51 smithi137 bash[27262]: cluster 1689212330.5651238 mgr.a (mgr.14152) 250 : cluster 0 pgmap v168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:52.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:51 smithi103 bash[27315]: cluster 1689212330.5651238 mgr.a (mgr.14152) 250 : cluster 0 pgmap v168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:52.124 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:51 smithi022 bash[47005]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:52.124 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:51 smithi022 bash[47005]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:38:52.124 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:51 smithi022 bash[47005]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:38:52.124 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:51 smithi022 bash[47005]: --> Failed to activate any OSD(s) 2023-07-13T01:38:53.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:53 smithi084 bash[27323]: cluster 1689212332.5655463 mgr.a (mgr.14152) 251 : cluster 0 pgmap v169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:53.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:53 smithi022 bash[26979]: cluster 1689212332.5655463 mgr.a (mgr.14152) 251 : cluster 0 pgmap v169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:53.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:53 smithi022 bash[47670]: debug 2023-07-13T01:38:53.799+0000 7eff2e689700 1 -- 172.21.15.22:0/2400561274 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556097bd8d00 con 0x556097c2ec00 2023-07-13T01:38:53.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:53 smithi022 bash[47670]: debug 2023-07-13T01:38:53.803+0000 7eff3780e640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:38:54.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:53 smithi154 bash[27744]: cluster 1689212332.5655463 mgr.a (mgr.14152) 251 : cluster 0 pgmap v169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:54.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:53 smithi137 bash[27262]: cluster 1689212332.5655463 mgr.a (mgr.14152) 251 : cluster 0 pgmap v169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:54.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:53 smithi103 bash[27315]: cluster 1689212332.5655463 mgr.a (mgr.14152) 251 : cluster 0 pgmap v169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:54.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:54 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:38:55.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:55 smithi154 bash[27744]: cluster 1689212334.5659716 mgr.a (mgr.14152) 252 : cluster 0 pgmap v170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:55.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:55 smithi137 bash[27262]: cluster 1689212334.5659716 mgr.a (mgr.14152) 252 : cluster 0 pgmap v170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:55.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:55 smithi103 bash[27315]: cluster 1689212334.5659716 mgr.a (mgr.14152) 252 : cluster 0 pgmap v170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:55.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:55 smithi084 bash[27323]: cluster 1689212334.5659716 mgr.a (mgr.14152) 252 : cluster 0 pgmap v170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:55.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:55 smithi022 bash[26979]: cluster 1689212334.5659716 mgr.a (mgr.14152) 252 : cluster 0 pgmap v170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:56.914 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:38:56 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:38:57.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:57 smithi084 bash[27323]: cluster 1689212336.5664368 mgr.a (mgr.14152) 253 : cluster 0 pgmap v171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:57.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:57 smithi022 bash[26979]: cluster 1689212336.5664368 mgr.a (mgr.14152) 253 : cluster 0 pgmap v171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:58.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:57 smithi154 bash[27744]: cluster 1689212336.5664368 mgr.a (mgr.14152) 253 : cluster 0 pgmap v171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:58.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:57 smithi137 bash[27262]: cluster 1689212336.5664368 mgr.a (mgr.14152) 253 : cluster 0 pgmap v171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:58.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:57 smithi103 bash[27315]: cluster 1689212336.5664368 mgr.a (mgr.14152) 253 : cluster 0 pgmap v171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:59.413 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:58 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:38:59.414 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:58 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:59.414 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:38:58 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:38:59.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:38:59 smithi022 bash[26979]: cluster 1689212338.5669029 mgr.a (mgr.14152) 254 : cluster 0 pgmap v172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:38:59.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:38:59 smithi084 bash[27323]: cluster 1689212338.5669029 mgr.a (mgr.14152) 254 : cluster 0 pgmap v172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:00.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:38:59 smithi154 bash[27744]: cluster 1689212338.5669029 mgr.a (mgr.14152) 254 : cluster 0 pgmap v172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:00.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:38:59 smithi137 bash[27262]: cluster 1689212338.5669029 mgr.a (mgr.14152) 254 : cluster 0 pgmap v172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:00.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:38:59 smithi103 bash[27315]: cluster 1689212338.5669029 mgr.a (mgr.14152) 254 : cluster 0 pgmap v172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:01.368 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:00 smithi022 bash[48004]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:01.369 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:00 smithi022 bash[48004]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:01.369 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:00 smithi022 bash[48004]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:01.369 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:00 smithi022 bash[48004]: --> Failed to activate any OSD(s) 2023-07-13T01:39:01.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:01 smithi084 bash[27323]: cluster 1689212340.5672088 mgr.a (mgr.14152) 255 : cluster 0 pgmap v173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:01.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:01 smithi022 bash[26979]: cluster 1689212340.5672088 mgr.a (mgr.14152) 255 : cluster 0 pgmap v173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:02.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:01 smithi154 bash[27744]: cluster 1689212340.5672088 mgr.a (mgr.14152) 255 : cluster 0 pgmap v173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:02.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:01 smithi137 bash[27262]: cluster 1689212340.5672088 mgr.a (mgr.14152) 255 : cluster 0 pgmap v173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:02.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:01 smithi103 bash[27315]: cluster 1689212340.5672088 mgr.a (mgr.14152) 255 : cluster 0 pgmap v173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:03.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:03 smithi084 bash[27323]: cluster 1689212342.5674844 mgr.a (mgr.14152) 256 : cluster 0 pgmap v174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:03.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:03 smithi022 bash[26979]: cluster 1689212342.5674844 mgr.a (mgr.14152) 256 : cluster 0 pgmap v174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:03.915 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:03 smithi022 bash[48194]: debug 2023-07-13T01:39:03.751+0000 7f209ba12700 1 -- 172.21.15.22:0/846900791 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f6788eed00 con 0x55f678944800 2023-07-13T01:39:03.915 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:03 smithi022 bash[48194]: debug 2023-07-13T01:39:03.755+0000 7f20a4b97640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:04.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:03 smithi154 bash[27744]: cluster 1689212342.5674844 mgr.a (mgr.14152) 256 : cluster 0 pgmap v174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:04.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:03 smithi137 bash[27262]: cluster 1689212342.5674844 mgr.a (mgr.14152) 256 : cluster 0 pgmap v174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:04.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:03 smithi103 bash[27315]: cluster 1689212342.5674844 mgr.a (mgr.14152) 256 : cluster 0 pgmap v174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:04.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:04 smithi022 bash[26979]: audit 1689212343.650751 mon.a (mon.0) 489 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-13T01:39:04.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:04 smithi022 bash[26979]: audit 1689212343.6522708 mon.a (mon.0) 490 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:04.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:04 smithi022 bash[26979]: cephadm 1689212343.6535408 mgr.a (mgr.14152) 257 : cephadm 1 Deploying daemon osd.2 on smithi022 2023-07-13T01:39:04.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:04 smithi084 bash[27323]: audit 1689212343.650751 mon.a (mon.0) 489 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-13T01:39:04.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:04 smithi084 bash[27323]: audit 1689212343.6522708 mon.a (mon.0) 490 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:04.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:04 smithi084 bash[27323]: cephadm 1689212343.6535408 mgr.a (mgr.14152) 257 : cephadm 1 Deploying daemon osd.2 on smithi022 2023-07-13T01:39:05.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:04 smithi154 bash[27744]: audit 1689212343.650751 mon.a (mon.0) 489 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-13T01:39:05.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:04 smithi154 bash[27744]: audit 1689212343.6522708 mon.a (mon.0) 490 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:05.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:04 smithi154 bash[27744]: cephadm 1689212343.6535408 mgr.a (mgr.14152) 257 : cephadm 1 Deploying daemon osd.2 on smithi022 2023-07-13T01:39:05.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:04 smithi137 bash[27262]: audit 1689212343.650751 mon.a (mon.0) 489 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-13T01:39:05.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:04 smithi137 bash[27262]: audit 1689212343.6522708 mon.a (mon.0) 490 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:05.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:04 smithi137 bash[27262]: cephadm 1689212343.6535408 mgr.a (mgr.14152) 257 : cephadm 1 Deploying daemon osd.2 on smithi022 2023-07-13T01:39:05.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:04 smithi103 bash[27315]: audit 1689212343.650751 mon.a (mon.0) 489 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-13T01:39:05.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:04 smithi103 bash[27315]: audit 1689212343.6522708 mon.a (mon.0) 490 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:05.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:04 smithi103 bash[27315]: cephadm 1689212343.6535408 mgr.a (mgr.14152) 257 : cephadm 1 Deploying daemon osd.2 on smithi022 2023-07-13T01:39:05.163 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:04 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:05.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:05 smithi084 bash[27323]: cluster 1689212344.567937 mgr.a (mgr.14152) 258 : cluster 0 pgmap v175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:05.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:05 smithi022 bash[26979]: cluster 1689212344.567937 mgr.a (mgr.14152) 258 : cluster 0 pgmap v175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:06.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:05 smithi154 bash[27744]: cluster 1689212344.567937 mgr.a (mgr.14152) 258 : cluster 0 pgmap v175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:06.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:05 smithi137 bash[27262]: cluster 1689212344.567937 mgr.a (mgr.14152) 258 : cluster 0 pgmap v175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:06.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:05 smithi103 bash[27315]: cluster 1689212344.567937 mgr.a (mgr.14152) 258 : cluster 0 pgmap v175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:07.163 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:06 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:39:07.164 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:06 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:07.164 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:06 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:07.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:07 smithi084 bash[27323]: cluster 1689212346.56839 mgr.a (mgr.14152) 259 : cluster 0 pgmap v176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:07.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:07 smithi022 bash[26979]: cluster 1689212346.56839 mgr.a (mgr.14152) 259 : cluster 0 pgmap v176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:07.914 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:07 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:39:08.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:07 smithi154 bash[27744]: cluster 1689212346.56839 mgr.a (mgr.14152) 259 : cluster 0 pgmap v176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:08.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:07 smithi137 bash[27262]: cluster 1689212346.56839 mgr.a (mgr.14152) 259 : cluster 0 pgmap v176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:08.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:07 smithi103 bash[27315]: cluster 1689212346.56839 mgr.a (mgr.14152) 259 : cluster 0 pgmap v176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:09.163 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:08 smithi022 bash[48603]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:09.164 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:08 smithi022 bash[48603]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:09.164 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:08 smithi022 bash[48603]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:09.164 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:08 smithi022 bash[48603]: --> Failed to activate any OSD(s) 2023-07-13T01:39:09.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:09 smithi022 bash[26979]: cluster 1689212348.5687478 mgr.a (mgr.14152) 260 : cluster 0 pgmap v177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:09.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:09 smithi084 bash[27323]: cluster 1689212348.5687478 mgr.a (mgr.14152) 260 : cluster 0 pgmap v177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:10.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:09 smithi154 bash[27744]: cluster 1689212348.5687478 mgr.a (mgr.14152) 260 : cluster 0 pgmap v177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:10.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:09 smithi137 bash[27262]: cluster 1689212348.5687478 mgr.a (mgr.14152) 260 : cluster 0 pgmap v177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:10.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:09 smithi103 bash[27315]: cluster 1689212348.5687478 mgr.a (mgr.14152) 260 : cluster 0 pgmap v177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:11.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:11 smithi103 bash[27315]: cluster 1689212350.5690734 mgr.a (mgr.14152) 261 : cluster 0 pgmap v178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:11.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:11 smithi103 bash[27315]: audit 1689212350.602035 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:11.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:11 smithi103 bash[27315]: audit 1689212350.608761 mon.a (mon.0) 492 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:11.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:11 smithi103 bash[27315]: audit 1689212350.6462379 mon.a (mon.0) 493 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:11.875 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:11 smithi022 bash[48812]: debug 2023-07-13T01:39:11.763+0000 7f73302e3700 1 -- 172.21.15.22:0/949258625 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cbac3bed00 con 0x55cbac414c00 2023-07-13T01:39:11.876 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:11 smithi022 bash[48812]: debug 2023-07-13T01:39:11.763+0000 7f7339468640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:11.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:11 smithi022 bash[26979]: cluster 1689212350.5690734 mgr.a (mgr.14152) 261 : cluster 0 pgmap v178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:11.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:11 smithi022 bash[26979]: audit 1689212350.602035 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:11.876 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:11 smithi022 bash[26979]: audit 1689212350.608761 mon.a (mon.0) 492 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:11.877 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:11 smithi022 bash[26979]: audit 1689212350.6462379 mon.a (mon.0) 493 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:11.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:11 smithi084 bash[27323]: cluster 1689212350.5690734 mgr.a (mgr.14152) 261 : cluster 0 pgmap v178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:11.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:11 smithi084 bash[27323]: audit 1689212350.602035 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:11.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:11 smithi084 bash[27323]: audit 1689212350.608761 mon.a (mon.0) 492 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:11.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:11 smithi084 bash[27323]: audit 1689212350.6462379 mon.a (mon.0) 493 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:12.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:11 smithi154 bash[27744]: cluster 1689212350.5690734 mgr.a (mgr.14152) 261 : cluster 0 pgmap v178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:12.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:11 smithi154 bash[27744]: audit 1689212350.602035 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:12.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:11 smithi154 bash[27744]: audit 1689212350.608761 mon.a (mon.0) 492 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:12.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:11 smithi154 bash[27744]: audit 1689212350.6462379 mon.a (mon.0) 493 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:12.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:11 smithi137 bash[27262]: cluster 1689212350.5690734 mgr.a (mgr.14152) 261 : cluster 0 pgmap v178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:12.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:11 smithi137 bash[27262]: audit 1689212350.602035 mon.a (mon.0) 491 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:12.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:11 smithi137 bash[27262]: audit 1689212350.608761 mon.a (mon.0) 492 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:12.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:11 smithi137 bash[27262]: audit 1689212350.6462379 mon.a (mon.0) 493 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:12.913 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:12 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:13.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:13 smithi103 bash[27315]: cluster 1689212352.5695643 mgr.a (mgr.14152) 262 : cluster 0 pgmap v179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:13.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:13 smithi084 bash[27323]: cluster 1689212352.5695643 mgr.a (mgr.14152) 262 : cluster 0 pgmap v179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:13.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:13 smithi022 bash[26979]: cluster 1689212352.5695643 mgr.a (mgr.14152) 262 : cluster 0 pgmap v179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:14.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:13 smithi154 bash[27744]: cluster 1689212352.5695643 mgr.a (mgr.14152) 262 : cluster 0 pgmap v179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:14.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:13 smithi137 bash[27262]: cluster 1689212352.5695643 mgr.a (mgr.14152) 262 : cluster 0 pgmap v179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:15.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:15 smithi022 bash[26979]: cluster 1689212354.570103 mgr.a (mgr.14152) 263 : cluster 0 pgmap v180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:15.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:15 smithi154 bash[27744]: cluster 1689212354.570103 mgr.a (mgr.14152) 263 : cluster 0 pgmap v180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:15.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:15 smithi137 bash[27262]: cluster 1689212354.570103 mgr.a (mgr.14152) 263 : cluster 0 pgmap v180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:15.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:15 smithi103 bash[27315]: cluster 1689212354.570103 mgr.a (mgr.14152) 263 : cluster 0 pgmap v180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:15.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:15 smithi084 bash[27323]: cluster 1689212354.570103 mgr.a (mgr.14152) 263 : cluster 0 pgmap v180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:16.413 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:16 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:39:17.882 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:17 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:39:17.882 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:17 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:17.882 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:17 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:17.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:17 smithi022 bash[26979]: cluster 1689212356.5707257 mgr.a (mgr.14152) 264 : cluster 0 pgmap v181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:17.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:17 smithi022 bash[26979]: audit 1689212357.2032328 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:17.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:17 smithi022 bash[26979]: audit 1689212357.2097647 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:17.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:17 smithi084 bash[27323]: cluster 1689212356.5707257 mgr.a (mgr.14152) 264 : cluster 0 pgmap v181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:17.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:17 smithi084 bash[27323]: audit 1689212357.2032328 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:17.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:17 smithi084 bash[27323]: audit 1689212357.2097647 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:17 smithi154 bash[27744]: cluster 1689212356.5707257 mgr.a (mgr.14152) 264 : cluster 0 pgmap v181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:17 smithi154 bash[27744]: audit 1689212357.2032328 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:17 smithi154 bash[27744]: audit 1689212357.2097647 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:17 smithi137 bash[27262]: cluster 1689212356.5707257 mgr.a (mgr.14152) 264 : cluster 0 pgmap v181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:17 smithi137 bash[27262]: audit 1689212357.2032328 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:17 smithi137 bash[27262]: audit 1689212357.2097647 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:17 smithi103 bash[27315]: cluster 1689212356.5707257 mgr.a (mgr.14152) 264 : cluster 0 pgmap v181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:17 smithi103 bash[27315]: audit 1689212357.2032328 mon.a (mon.0) 494 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:17 smithi103 bash[27315]: audit 1689212357.2097647 mon.a (mon.0) 495 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:18 smithi084 bash[27323]: audit 1689212357.6775694 mon.a (mon.0) 496 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:18.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:18 smithi084 bash[27323]: audit 1689212357.6789823 mon.a (mon.0) 497 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:18.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:18 smithi084 bash[27323]: cluster 1689212357.6813514 mgr.a (mgr.14152) 265 : cluster 0 pgmap v182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:18 smithi084 bash[27323]: cluster 1689212357.6816022 mgr.a (mgr.14152) 266 : cluster 0 pgmap v183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:18 smithi084 bash[27323]: audit 1689212357.6877916 mon.a (mon.0) 498 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:18.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:18 smithi022 bash[26979]: audit 1689212357.6775694 mon.a (mon.0) 496 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:18.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:18 smithi022 bash[26979]: audit 1689212357.6789823 mon.a (mon.0) 497 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:18.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:18 smithi022 bash[26979]: cluster 1689212357.6813514 mgr.a (mgr.14152) 265 : cluster 0 pgmap v182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:18 smithi022 bash[26979]: cluster 1689212357.6816022 mgr.a (mgr.14152) 266 : cluster 0 pgmap v183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:18.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:18 smithi022 bash[26979]: audit 1689212357.6877916 mon.a (mon.0) 498 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:19.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:18 smithi154 bash[27744]: audit 1689212357.6775694 mon.a (mon.0) 496 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:19.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:18 smithi154 bash[27744]: audit 1689212357.6789823 mon.a (mon.0) 497 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:19.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:18 smithi154 bash[27744]: cluster 1689212357.6813514 mgr.a (mgr.14152) 265 : cluster 0 pgmap v182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:19.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:18 smithi154 bash[27744]: cluster 1689212357.6816022 mgr.a (mgr.14152) 266 : cluster 0 pgmap v183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:19.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:18 smithi154 bash[27744]: audit 1689212357.6877916 mon.a (mon.0) 498 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:19.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:18 smithi137 bash[27262]: audit 1689212357.6775694 mon.a (mon.0) 496 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:19.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:18 smithi137 bash[27262]: audit 1689212357.6789823 mon.a (mon.0) 497 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:19.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:18 smithi137 bash[27262]: cluster 1689212357.6813514 mgr.a (mgr.14152) 265 : cluster 0 pgmap v182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:19.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:18 smithi137 bash[27262]: cluster 1689212357.6816022 mgr.a (mgr.14152) 266 : cluster 0 pgmap v183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:19.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:18 smithi137 bash[27262]: audit 1689212357.6877916 mon.a (mon.0) 498 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:19.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:18 smithi103 bash[27315]: audit 1689212357.6775694 mon.a (mon.0) 496 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:19.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:18 smithi103 bash[27315]: audit 1689212357.6789823 mon.a (mon.0) 497 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:19.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:18 smithi103 bash[27315]: cluster 1689212357.6813514 mgr.a (mgr.14152) 265 : cluster 0 pgmap v182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:19.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:18 smithi103 bash[27315]: cluster 1689212357.6816022 mgr.a (mgr.14152) 266 : cluster 0 pgmap v183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:19.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:18 smithi103 bash[27315]: audit 1689212357.6877916 mon.a (mon.0) 498 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:19.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:19 smithi084 bash[27323]: cluster 1689212358.6251638 mon.a (mon.0) 499 : cluster 3 Health check update: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:39:19.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:19 smithi022 bash[26979]: cluster 1689212358.6251638 mon.a (mon.0) 499 : cluster 3 Health check update: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:39:20.016 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:19 smithi154 bash[27744]: cluster 1689212358.6251638 mon.a (mon.0) 499 : cluster 3 Health check update: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:39:20.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:19 smithi137 bash[27262]: cluster 1689212358.6251638 mon.a (mon.0) 499 : cluster 3 Health check update: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:39:20.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:19 smithi103 bash[27315]: cluster 1689212358.6251638 mon.a (mon.0) 499 : cluster 3 Health check update: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:39:20.573 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:20 smithi022 bash[49861]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:20.573 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:20 smithi022 bash[49861]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:20.573 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:20 smithi022 bash[49861]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:20.573 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:20 smithi022 bash[49861]: --> Failed to activate any OSD(s) 2023-07-13T01:39:20.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:20 smithi084 bash[27323]: cluster 1689212359.6820514 mgr.a (mgr.14152) 267 : cluster 0 pgmap v184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:20.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:20 smithi022 bash[26979]: cluster 1689212359.6820514 mgr.a (mgr.14152) 267 : cluster 0 pgmap v184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:21.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:20 smithi154 bash[27744]: cluster 1689212359.6820514 mgr.a (mgr.14152) 267 : cluster 0 pgmap v184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:21.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:20 smithi137 bash[27262]: cluster 1689212359.6820514 mgr.a (mgr.14152) 267 : cluster 0 pgmap v184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:21.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:20 smithi103 bash[27315]: cluster 1689212359.6820514 mgr.a (mgr.14152) 267 : cluster 0 pgmap v184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:22.000 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 2 on host 'smithi022' 2023-07-13T01:39:22.881 DEBUG:teuthology.orchestra.run.smithi022:osd.2> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service 2023-07-13T01:39:22.884 INFO:tasks.cephadm:Deploying osd.3 on smithi084 with /dev/vg_nvme/lv_4... 2023-07-13T01:39:22.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-13T01:39:22.955 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:22 smithi022 bash[50071]: debug 2023-07-13T01:39:22.874+0000 7f138e6dc700 1 -- 172.21.15.22:0/4144474266 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b578bf6d00 con 0x55b578c4c800 2023-07-13T01:39:22.956 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:22 smithi022 bash[50071]: debug 2023-07-13T01:39:22.874+0000 7f1397861640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:22.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:22 smithi022 bash[26979]: cluster 1689212361.6825273 mgr.a (mgr.14152) 268 : cluster 0 pgmap v185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:22.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:22 smithi022 bash[26979]: audit 1689212361.9583523 mon.a (mon.0) 500 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:22.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:22 smithi022 bash[26979]: audit 1689212361.9642782 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:22.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:22 smithi022 bash[26979]: audit 1689212361.9788074 mon.a (mon.0) 502 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:23.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:22 smithi084 bash[27323]: cluster 1689212361.6825273 mgr.a (mgr.14152) 268 : cluster 0 pgmap v185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:23.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:22 smithi084 bash[27323]: audit 1689212361.9583523 mon.a (mon.0) 500 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:22 smithi084 bash[27323]: audit 1689212361.9642782 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:22 smithi084 bash[27323]: audit 1689212361.9788074 mon.a (mon.0) 502 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:23.263 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:22 smithi154 bash[27744]: cluster 1689212361.6825273 mgr.a (mgr.14152) 268 : cluster 0 pgmap v185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:23.264 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:22 smithi154 bash[27744]: audit 1689212361.9583523 mon.a (mon.0) 500 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.264 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:22 smithi154 bash[27744]: audit 1689212361.9642782 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.264 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:22 smithi154 bash[27744]: audit 1689212361.9788074 mon.a (mon.0) 502 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:23.311 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:22 smithi137 bash[27262]: cluster 1689212361.6825273 mgr.a (mgr.14152) 268 : cluster 0 pgmap v185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:23.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:22 smithi137 bash[27262]: audit 1689212361.9583523 mon.a (mon.0) 500 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:22 smithi137 bash[27262]: audit 1689212361.9642782 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.312 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:22 smithi137 bash[27262]: audit 1689212361.9788074 mon.a (mon.0) 502 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:23.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:22 smithi103 bash[27315]: cluster 1689212361.6825273 mgr.a (mgr.14152) 268 : cluster 0 pgmap v185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:23.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:22 smithi103 bash[27315]: audit 1689212361.9583523 mon.a (mon.0) 500 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.361 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:22 smithi103 bash[27315]: audit 1689212361.9642782 mon.a (mon.0) 501 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:23.361 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:22 smithi103 bash[27315]: audit 1689212361.9788074 mon.a (mon.0) 502 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:39:23.643 INFO:journalctl@ceph.osd.2.smithi022.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:39:24.163 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:23 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:25.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:24 smithi022 bash[26979]: cluster 1689212363.6829722 mgr.a (mgr.14152) 269 : cluster 0 pgmap v186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:25.263 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:24 smithi154 bash[27744]: cluster 1689212363.6829722 mgr.a (mgr.14152) 269 : cluster 0 pgmap v186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:25.311 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:24 smithi137 bash[27262]: cluster 1689212363.6829722 mgr.a (mgr.14152) 269 : cluster 0 pgmap v186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:25.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:24 smithi103 bash[27315]: cluster 1689212363.6829722 mgr.a (mgr.14152) 269 : cluster 0 pgmap v186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:25.400 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:24 smithi084 bash[27323]: cluster 1689212363.6829722 mgr.a (mgr.14152) 269 : cluster 0 pgmap v186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:26.163 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:25 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:39:26.663 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:26 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:39:26.664 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:26 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:26.664 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:26 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:27.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:26 smithi022 bash[26979]: cluster 1689212365.6834054 mgr.a (mgr.14152) 270 : cluster 0 pgmap v187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:27.263 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:26 smithi154 bash[27744]: cluster 1689212365.6834054 mgr.a (mgr.14152) 270 : cluster 0 pgmap v187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:27.311 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:26 smithi137 bash[27262]: cluster 1689212365.6834054 mgr.a (mgr.14152) 270 : cluster 0 pgmap v187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:27.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:26 smithi103 bash[27315]: cluster 1689212365.6834054 mgr.a (mgr.14152) 270 : cluster 0 pgmap v187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:27.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:26 smithi084 bash[27323]: cluster 1689212365.6834054 mgr.a (mgr.14152) 270 : cluster 0 pgmap v187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:27.575 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.b/config 2023-07-13T01:39:28.335 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:28 smithi022 bash[50399]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:28.335 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:28 smithi022 bash[50399]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:28.335 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:28 smithi022 bash[50399]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:28.335 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:28 smithi022 bash[50399]: --> Failed to activate any OSD(s) 2023-07-13T01:39:29.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:28 smithi022 bash[26979]: cluster 1689212367.6838906 mgr.a (mgr.14152) 271 : cluster 0 pgmap v188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:29.263 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:28 smithi154 bash[27744]: cluster 1689212367.6838906 mgr.a (mgr.14152) 271 : cluster 0 pgmap v188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:29.311 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:28 smithi137 bash[27262]: cluster 1689212367.6838906 mgr.a (mgr.14152) 271 : cluster 0 pgmap v188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:29.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:28 smithi103 bash[27315]: cluster 1689212367.6838906 mgr.a (mgr.14152) 271 : cluster 0 pgmap v188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:29.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:28 smithi084 bash[27323]: cluster 1689212367.6838906 mgr.a (mgr.14152) 271 : cluster 0 pgmap v188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:29.663 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:29 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:39:29.663 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:29 smithi022 systemd[1]: Stopped Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:29.663 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:29 smithi022 systemd[1]: Started Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:30.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:30 smithi154 bash[27744]: cluster 1689212369.6842446 mgr.a (mgr.14152) 272 : cluster 0 pgmap v189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:30.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:30 smithi137 bash[27262]: cluster 1689212369.6842446 mgr.a (mgr.14152) 272 : cluster 0 pgmap v189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:30.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:30 smithi103 bash[27315]: cluster 1689212369.6842446 mgr.a (mgr.14152) 272 : cluster 0 pgmap v189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:30.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:30 smithi084 bash[27323]: cluster 1689212369.6842446 mgr.a (mgr.14152) 272 : cluster 0 pgmap v189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:30.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:30 smithi022 bash[26979]: cluster 1689212369.6842446 mgr.a (mgr.14152) 272 : cluster 0 pgmap v189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-13T01:39:31.115 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-13T01:39:31.116 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2023-07-13T01:39:31.116 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2023-07-13T01:39:31.116 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0181154 s, 579 MB/s 2023-07-13T01:39:31.116 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2023-07-13T01:39:31.279 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:31 smithi022 bash[50613]: debug 2023-07-13T01:39:31.190+0000 7fedb1559700 1 -- 172.21.15.22:0/439154110 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558043be0d00 con 0x558043c37000 2023-07-13T01:39:31.280 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:31 smithi022 bash[50613]: debug 2023-07-13T01:39:31.194+0000 7fedba6de640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:31.724 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:31 smithi022 bash[50600]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:31.724 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:31 smithi022 bash[50600]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:31.725 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:31 smithi022 bash[50600]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:31.725 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:31 smithi022 bash[50600]: --> Failed to activate any OSD(s) 2023-07-13T01:39:31.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2023-07-13T01:39:32.663 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:32 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:33.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:32 smithi154 bash[27744]: cluster 1689212371.6846445 mgr.a (mgr.14152) 273 : cluster 0 pgmap v190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:33.016 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:32 smithi022 bash[26979]: cluster 1689212371.6846445 mgr.a (mgr.14152) 273 : cluster 0 pgmap v190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:33.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:32 smithi137 bash[27262]: cluster 1689212371.6846445 mgr.a (mgr.14152) 273 : cluster 0 pgmap v190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:33.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:32 smithi103 bash[27315]: cluster 1689212371.6846445 mgr.a (mgr.14152) 273 : cluster 0 pgmap v190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:33.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:32 smithi084 bash[27323]: cluster 1689212371.6846445 mgr.a (mgr.14152) 273 : cluster 0 pgmap v190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:34.483 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[51533]: debug 2023-07-13T01:39:34.386+0000 7f142eaf4700 1 -- 172.21.15.22:0/1003234580 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f6eacf8d00 con 0x55f6ead4e800 2023-07-13T01:39:34.483 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[51533]: debug 2023-07-13T01:39:34.386+0000 7f1437c79640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:34.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: cephadm 1689212373.6261783 mgr.a (mgr.14152) 274 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:39:34.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.6332572 mon.a (mon.0) 503 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.6403105 mon.a (mon.0) 504 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.6419947 mon.a (mon.0) 505 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:34.846 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.643251 mon.a (mon.0) 506 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:34.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.6444445 mon.a (mon.0) 507 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:34.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: cephadm 1689212373.6454103 mgr.a (mgr.14152) 275 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:39:34.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.6508071 mon.a (mon.0) 508 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.652626 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:34.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.653806 mon.a (mon.0) 510 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:34.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: cluster 1689212373.656263 mgr.a (mgr.14152) 276 : cluster 0 pgmap v191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:34.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: cluster 1689212373.656534 mgr.a (mgr.14152) 277 : cluster 0 pgmap v192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:34.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:34 smithi022 bash[26979]: audit 1689212373.6630151 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: cephadm 1689212373.6261783 mgr.a (mgr.14152) 274 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:39:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.6332572 mon.a (mon.0) 503 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.6403105 mon.a (mon.0) 504 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.6419947 mon.a (mon.0) 505 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.643251 mon.a (mon.0) 506 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.6444445 mon.a (mon.0) 507 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: cephadm 1689212373.6454103 mgr.a (mgr.14152) 275 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.6508071 mon.a (mon.0) 508 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.652626 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.653806 mon.a (mon.0) 510 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: cluster 1689212373.656263 mgr.a (mgr.14152) 276 : cluster 0 pgmap v191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: cluster 1689212373.656534 mgr.a (mgr.14152) 277 : cluster 0 pgmap v192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:34.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:34 smithi084 bash[27323]: audit 1689212373.6630151 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: cephadm 1689212373.6261783 mgr.a (mgr.14152) 274 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:39:35.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.6332572 mon.a (mon.0) 503 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.6403105 mon.a (mon.0) 504 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.6419947 mon.a (mon.0) 505 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.643251 mon.a (mon.0) 506 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.6444445 mon.a (mon.0) 507 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: cephadm 1689212373.6454103 mgr.a (mgr.14152) 275 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:39:35.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.6508071 mon.a (mon.0) 508 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.652626 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:35.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.653806 mon.a (mon.0) 510 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:35.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: cluster 1689212373.656263 mgr.a (mgr.14152) 276 : cluster 0 pgmap v191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:35.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: cluster 1689212373.656534 mgr.a (mgr.14152) 277 : cluster 0 pgmap v192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:35.015 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:34 smithi154 bash[27744]: audit 1689212373.6630151 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: cephadm 1689212373.6261783 mgr.a (mgr.14152) 274 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:39:35.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.6332572 mon.a (mon.0) 503 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.6403105 mon.a (mon.0) 504 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.6419947 mon.a (mon.0) 505 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.643251 mon.a (mon.0) 506 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.6444445 mon.a (mon.0) 507 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: cephadm 1689212373.6454103 mgr.a (mgr.14152) 275 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.6508071 mon.a (mon.0) 508 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.652626 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.653806 mon.a (mon.0) 510 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:35.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: cluster 1689212373.656263 mgr.a (mgr.14152) 276 : cluster 0 pgmap v191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:35.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: cluster 1689212373.656534 mgr.a (mgr.14152) 277 : cluster 0 pgmap v192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:35.063 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:34 smithi137 bash[27262]: audit 1689212373.6630151 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: cephadm 1689212373.6261783 mgr.a (mgr.14152) 274 : cephadm 1 Detected new or changed devices on smithi022 2023-07-13T01:39:35.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.6332572 mon.a (mon.0) 503 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.6403105 mon.a (mon.0) 504 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.6419947 mon.a (mon.0) 505 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.643251 mon.a (mon.0) 506 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.6444445 mon.a (mon.0) 507 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:39:35.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: cephadm 1689212373.6454103 mgr.a (mgr.14152) 275 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:39:35.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.6508071 mon.a (mon.0) 508 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.652626 mon.a (mon.0) 509 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:35.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.653806 mon.a (mon.0) 510 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:39:35.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: cluster 1689212373.656263 mgr.a (mgr.14152) 276 : cluster 0 pgmap v191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:35.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: cluster 1689212373.656534 mgr.a (mgr.14152) 277 : cluster 0 pgmap v192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:35.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:34 smithi103 bash[27315]: audit 1689212373.6630151 mon.a (mon.0) 511 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:39:35.561 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:35 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:36.413 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:36 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:39:36.413 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:35 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:39:36.413 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:35 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:36.414 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:35 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.b/config 2023-07-13T01:39:36.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:36 smithi084 bash[27323]: cluster 1689212375.656874 mgr.a (mgr.14152) 278 : cluster 0 pgmap v193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:37.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:36 smithi154 bash[27744]: cluster 1689212375.656874 mgr.a (mgr.14152) 278 : cluster 0 pgmap v193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:37.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:36 smithi137 bash[27262]: cluster 1689212375.656874 mgr.a (mgr.14152) 278 : cluster 0 pgmap v193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:37.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:36 smithi103 bash[27315]: cluster 1689212375.656874 mgr.a (mgr.14152) 278 : cluster 0 pgmap v193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:37.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:36 smithi022 bash[26979]: cluster 1689212375.656874 mgr.a (mgr.14152) 278 : cluster 0 pgmap v193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:38.163 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:37 smithi022 bash[51794]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:38.163 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:37 smithi022 bash[51794]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:38.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:37 smithi022 bash[51794]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:38.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:37 smithi022 bash[51794]: --> Failed to activate any OSD(s) 2023-07-13T01:39:38.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:38 smithi022 bash[26979]: cluster 1689212377.6572778 mgr.a (mgr.14152) 279 : cluster 0 pgmap v194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:38.913 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:38 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2023-07-13T01:39:39.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:38 smithi154 bash[27744]: cluster 1689212377.6572778 mgr.a (mgr.14152) 279 : cluster 0 pgmap v194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:39.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:38 smithi137 bash[27262]: cluster 1689212377.6572778 mgr.a (mgr.14152) 279 : cluster 0 pgmap v194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:39.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:38 smithi103 bash[27315]: cluster 1689212377.6572778 mgr.a (mgr.14152) 279 : cluster 0 pgmap v194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:39.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:38 smithi084 bash[27323]: cluster 1689212377.6572778 mgr.a (mgr.14152) 279 : cluster 0 pgmap v194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:39.913 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:39 smithi022 bash[51971]: debug 2023-07-13T01:39:39.782+0000 7fbb3327e700 1 -- 172.21.15.22:0/3286026440 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5602f1852d00 con 0x5602f18a8800 2023-07-13T01:39:39.913 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:39 smithi022 bash[51971]: debug 2023-07-13T01:39:39.782+0000 7fbb3c403640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:40.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:40 smithi154 bash[27744]: cluster 1689212379.657745 mgr.a (mgr.14152) 280 : cluster 0 pgmap v195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:40.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:40 smithi154 bash[27744]: audit 1689212379.6757777 mgr.a (mgr.14152) 281 : audit 0 from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:39:40.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:40 smithi154 bash[27744]: audit 1689212379.6807625 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:39:40.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:40 smithi154 bash[27744]: audit 1689212379.6853254 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:39:40.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:40 smithi154 bash[27744]: audit 1689212379.6864843 mon.a (mon.0) 514 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:40.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:40 smithi137 bash[27262]: cluster 1689212379.657745 mgr.a (mgr.14152) 280 : cluster 0 pgmap v195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:40.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:40 smithi137 bash[27262]: audit 1689212379.6757777 mgr.a (mgr.14152) 281 : audit 0 from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:39:40.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:40 smithi137 bash[27262]: audit 1689212379.6807625 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:39:40.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:40 smithi137 bash[27262]: audit 1689212379.6853254 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:39:40.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:40 smithi137 bash[27262]: audit 1689212379.6864843 mon.a (mon.0) 514 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:40.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:40 smithi103 bash[27315]: cluster 1689212379.657745 mgr.a (mgr.14152) 280 : cluster 0 pgmap v195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:40.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:40 smithi103 bash[27315]: audit 1689212379.6757777 mgr.a (mgr.14152) 281 : audit 0 from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:39:40.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:40 smithi103 bash[27315]: audit 1689212379.6807625 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:39:40.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:40 smithi103 bash[27315]: audit 1689212379.6853254 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:39:40.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:40 smithi103 bash[27315]: audit 1689212379.6864843 mon.a (mon.0) 514 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:40.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:40 smithi084 bash[27323]: cluster 1689212379.657745 mgr.a (mgr.14152) 280 : cluster 0 pgmap v195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:40.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:40 smithi084 bash[27323]: audit 1689212379.6757777 mgr.a (mgr.14152) 281 : audit 0 from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:39:40.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:40 smithi084 bash[27323]: audit 1689212379.6807625 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:39:40.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:40 smithi084 bash[27323]: audit 1689212379.6853254 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:39:40.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:40 smithi084 bash[27323]: audit 1689212379.6864843 mon.a (mon.0) 514 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:40.913 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:40 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:40.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:40 smithi022 bash[26979]: cluster 1689212379.657745 mgr.a (mgr.14152) 280 : cluster 0 pgmap v195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:40.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:40 smithi022 bash[26979]: audit 1689212379.6757777 mgr.a (mgr.14152) 281 : audit 0 from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:39:40.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:40 smithi022 bash[26979]: audit 1689212379.6807625 mon.a (mon.0) 512 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:39:40.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:40 smithi022 bash[26979]: audit 1689212379.6853254 mon.a (mon.0) 513 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:39:40.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:40 smithi022 bash[26979]: audit 1689212379.6864843 mon.a (mon.0) 514 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:39:43.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:42 smithi154 bash[27744]: cluster 1689212381.6582184 mgr.a (mgr.14152) 282 : cluster 0 pgmap v196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:43.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:42 smithi137 bash[27262]: cluster 1689212381.6582184 mgr.a (mgr.14152) 282 : cluster 0 pgmap v196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:43.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:42 smithi103 bash[27315]: cluster 1689212381.6582184 mgr.a (mgr.14152) 282 : cluster 0 pgmap v196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:43.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:42 smithi084 bash[27323]: cluster 1689212381.6582184 mgr.a (mgr.14152) 282 : cluster 0 pgmap v196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:43.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:42 smithi022 bash[26979]: cluster 1689212381.6582184 mgr.a (mgr.14152) 282 : cluster 0 pgmap v196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:43.163 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:42 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:39:44.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:44 smithi084 bash[27323]: cluster 1689212383.6586704 mgr.a (mgr.14152) 283 : cluster 0 pgmap v197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:45.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:44 smithi154 bash[27744]: cluster 1689212383.6586704 mgr.a (mgr.14152) 283 : cluster 0 pgmap v197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:45.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:44 smithi137 bash[27262]: cluster 1689212383.6586704 mgr.a (mgr.14152) 283 : cluster 0 pgmap v197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:45.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:44 smithi103 bash[27315]: cluster 1689212383.6586704 mgr.a (mgr.14152) 283 : cluster 0 pgmap v197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:45.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:44 smithi022 bash[26979]: cluster 1689212383.6586704 mgr.a (mgr.14152) 283 : cluster 0 pgmap v197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:46.662 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:46 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:39:46.663 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:46 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:46.663 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:46 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:46.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:46 smithi084 bash[27323]: cluster 1689212385.6591363 mgr.a (mgr.14152) 284 : cluster 0 pgmap v198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:47.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:46 smithi154 bash[27744]: cluster 1689212385.6591363 mgr.a (mgr.14152) 284 : cluster 0 pgmap v198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:47.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:46 smithi137 bash[27262]: cluster 1689212385.6591363 mgr.a (mgr.14152) 284 : cluster 0 pgmap v198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:47.072 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:46 smithi022 bash[26979]: cluster 1689212385.6591363 mgr.a (mgr.14152) 284 : cluster 0 pgmap v198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:47.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:46 smithi103 bash[27315]: cluster 1689212385.6591363 mgr.a (mgr.14152) 284 : cluster 0 pgmap v198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:47.670 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:47 smithi022 bash[52229]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:47.670 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:47 smithi022 bash[52229]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:47.670 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:47 smithi022 bash[52229]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:47.671 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:47 smithi022 bash[52229]: --> Failed to activate any OSD(s) 2023-07-13T01:39:49.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: cluster 1689212387.659598 mgr.a (mgr.14152) 285 : cluster 0 pgmap v199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:49.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.5080917 mon.a (mon.0) 515 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.5101283 mon.e (mon.1) 10 : audit 1 from='client.? 172.21.15.84:0/343467385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.518309 mon.a (mon.0) 516 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]': finished 2023-07-13T01:39:49.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: cluster 1689212388.5184748 mon.a (mon.0) 517 : cluster 0 osdmap e8: 4 total, 0 up, 4 in 2023-07-13T01:39:49.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.5186477 mon.a (mon.0) 518 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:39:49.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.5190625 mon.a (mon.0) 519 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:39:49.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.5192785 mon.a (mon.0) 520 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:39:49.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:48 smithi154 bash[27744]: audit 1689212388.5195248 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:39:49.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: cluster 1689212387.659598 mgr.a (mgr.14152) 285 : cluster 0 pgmap v199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:49.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.5080917 mon.a (mon.0) 515 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.5101283 mon.e (mon.1) 10 : audit 1 from='client.? 172.21.15.84:0/343467385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.518309 mon.a (mon.0) 516 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]': finished 2023-07-13T01:39:49.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: cluster 1689212388.5184748 mon.a (mon.0) 517 : cluster 0 osdmap e8: 4 total, 0 up, 4 in 2023-07-13T01:39:49.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.5186477 mon.a (mon.0) 518 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:39:49.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.5190625 mon.a (mon.0) 519 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:39:49.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.5192785 mon.a (mon.0) 520 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:39:49.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:48 smithi137 bash[27262]: audit 1689212388.5195248 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:39:49.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: cluster 1689212387.659598 mgr.a (mgr.14152) 285 : cluster 0 pgmap v199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:49.110 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.5080917 mon.a (mon.0) 515 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.5101283 mon.e (mon.1) 10 : audit 1 from='client.? 172.21.15.84:0/343467385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.518309 mon.a (mon.0) 516 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]': finished 2023-07-13T01:39:49.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: cluster 1689212388.5184748 mon.a (mon.0) 517 : cluster 0 osdmap e8: 4 total, 0 up, 4 in 2023-07-13T01:39:49.111 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.5186477 mon.a (mon.0) 518 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:39:49.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.5190625 mon.a (mon.0) 519 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:39:49.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.5192785 mon.a (mon.0) 520 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:39:49.112 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:48 smithi103 bash[27315]: audit 1689212388.5195248 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:39:49.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: cluster 1689212387.659598 mgr.a (mgr.14152) 285 : cluster 0 pgmap v199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:49.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.5080917 mon.a (mon.0) 515 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.5101283 mon.e (mon.1) 10 : audit 1 from='client.? 172.21.15.84:0/343467385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.518309 mon.a (mon.0) 516 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]': finished 2023-07-13T01:39:49.152 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: cluster 1689212388.5184748 mon.a (mon.0) 517 : cluster 0 osdmap e8: 4 total, 0 up, 4 in 2023-07-13T01:39:49.152 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.5186477 mon.a (mon.0) 518 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:39:49.152 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.5190625 mon.a (mon.0) 519 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:39:49.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.5192785 mon.a (mon.0) 520 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:39:49.153 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:48 smithi084 bash[27323]: audit 1689212388.5195248 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:39:49.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: cluster 1689212387.659598 mgr.a (mgr.14152) 285 : cluster 0 pgmap v199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:49.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.5080917 mon.a (mon.0) 515 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.5101283 mon.e (mon.1) 10 : audit 1 from='client.? 172.21.15.84:0/343467385' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]: dispatch 2023-07-13T01:39:49.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.518309 mon.a (mon.0) 516 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b281916-53a0-4eef-b72c-e7b57f0d887b"}]': finished 2023-07-13T01:39:49.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: cluster 1689212388.5184748 mon.a (mon.0) 517 : cluster 0 osdmap e8: 4 total, 0 up, 4 in 2023-07-13T01:39:49.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.5186477 mon.a (mon.0) 518 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:39:49.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.5190625 mon.a (mon.0) 519 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:39:49.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.5192785 mon.a (mon.0) 520 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:39:49.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:48 smithi022 bash[26979]: audit 1689212388.5195248 mon.a (mon.0) 521 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:39:49.165 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:48 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:39:49.166 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:48 smithi022 systemd[1]: Stopped Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:49.166 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:48 smithi022 systemd[1]: Started Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:49 smithi022 bash[26979]: audit 1689212389.217735 mon.a (mon.0) 522 : audit 0 from='client.? 172.21.15.84:0/794170640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:39:49.913 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:49 smithi022 bash[52333]: debug 2023-07-13T01:39:49.638+0000 7fec92b12700 1 -- 172.21.15.22:0/2038456255 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56045d598d00 con 0x56045d5eec00 2023-07-13T01:39:49.913 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:49 smithi022 bash[52333]: debug 2023-07-13T01:39:49.638+0000 7fec9bc97640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:50.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:49 smithi154 bash[27744]: audit 1689212389.217735 mon.a (mon.0) 522 : audit 0 from='client.? 172.21.15.84:0/794170640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:39:50.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:49 smithi137 bash[27262]: audit 1689212389.217735 mon.a (mon.0) 522 : audit 0 from='client.? 172.21.15.84:0/794170640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:39:50.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:49 smithi103 bash[27315]: audit 1689212389.217735 mon.a (mon.0) 522 : audit 0 from='client.? 172.21.15.84:0/794170640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:39:50.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:49 smithi084 bash[27323]: audit 1689212389.217735 mon.a (mon.0) 522 : audit 0 from='client.? 172.21.15.84:0/794170640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:39:50.737 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:50 smithi022 bash[52368]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:50.737 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:50 smithi022 bash[52368]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:50.737 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:50 smithi022 bash[52368]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:50.737 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:50 smithi022 bash[52368]: --> Failed to activate any OSD(s) 2023-07-13T01:39:50.738 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:50 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:50.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:50 smithi022 bash[26979]: cluster 1689212389.660124 mgr.a (mgr.14152) 286 : cluster 0 pgmap v201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:51.013 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:50 smithi154 bash[27744]: cluster 1689212389.660124 mgr.a (mgr.14152) 286 : cluster 0 pgmap v201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:51.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:50 smithi137 bash[27262]: cluster 1689212389.660124 mgr.a (mgr.14152) 286 : cluster 0 pgmap v201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:51.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:50 smithi103 bash[27315]: cluster 1689212389.660124 mgr.a (mgr.14152) 286 : cluster 0 pgmap v201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:51.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:50 smithi084 bash[27323]: cluster 1689212389.660124 mgr.a (mgr.14152) 286 : cluster 0 pgmap v201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:53.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:52 smithi154 bash[27744]: cluster 1689212391.660737 mgr.a (mgr.14152) 287 : cluster 0 pgmap v202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:53.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:52 smithi137 bash[27262]: cluster 1689212391.660737 mgr.a (mgr.14152) 287 : cluster 0 pgmap v202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:53.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:52 smithi103 bash[27315]: cluster 1689212391.660737 mgr.a (mgr.14152) 287 : cluster 0 pgmap v202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:53.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:52 smithi084 bash[27323]: cluster 1689212391.660737 mgr.a (mgr.14152) 287 : cluster 0 pgmap v202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:53.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:52 smithi022 bash[26979]: cluster 1689212391.660737 mgr.a (mgr.14152) 287 : cluster 0 pgmap v202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:53.163 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:52 smithi022 bash[52618]: debug 2023-07-13T01:39:52.854+0000 7f56fb5f9700 1 -- 172.21.15.22:0/1367777635 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bfef628d00 con 0x55bfef67ec00 2023-07-13T01:39:53.164 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:52 smithi022 bash[52618]: debug 2023-07-13T01:39:52.858+0000 7f570477e640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:53.164 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:52 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:39:53.165 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:52 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:53.165 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:52 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:39:54.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:54 smithi022 bash[26979]: cluster 1689212393.661208 mgr.a (mgr.14152) 288 : cluster 0 pgmap v203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:54.913 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:39:54 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:39:54.913 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:54 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:55.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:54 smithi154 bash[27744]: cluster 1689212393.661208 mgr.a (mgr.14152) 288 : cluster 0 pgmap v203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:55.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:54 smithi137 bash[27262]: cluster 1689212393.661208 mgr.a (mgr.14152) 288 : cluster 0 pgmap v203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:55.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:54 smithi103 bash[27315]: cluster 1689212393.661208 mgr.a (mgr.14152) 288 : cluster 0 pgmap v203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:55.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:54 smithi084 bash[27323]: cluster 1689212393.661208 mgr.a (mgr.14152) 288 : cluster 0 pgmap v203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:55.666 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:55 smithi022 bash[52750]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:55.667 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:55 smithi022 bash[52750]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:39:55.667 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:55 smithi022 bash[52750]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:39:55.667 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:55 smithi022 bash[52750]: --> Failed to activate any OSD(s) 2023-07-13T01:39:56.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:56 smithi022 bash[26979]: cluster 1689212395.6618016 mgr.a (mgr.14152) 289 : cluster 0 pgmap v204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:57.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:56 smithi154 bash[27744]: cluster 1689212395.6618016 mgr.a (mgr.14152) 289 : cluster 0 pgmap v204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:57.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:56 smithi137 bash[27262]: cluster 1689212395.6618016 mgr.a (mgr.14152) 289 : cluster 0 pgmap v204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:57.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:56 smithi103 bash[27315]: cluster 1689212395.6618016 mgr.a (mgr.14152) 289 : cluster 0 pgmap v204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:57.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:56 smithi084 bash[27323]: cluster 1689212395.6618016 mgr.a (mgr.14152) 289 : cluster 0 pgmap v204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:58.226 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:39:57 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2023-07-13T01:39:58.226 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:58 smithi022 bash[53006]: debug 2023-07-13T01:39:58.134+0000 7f8b1bdd7700 1 -- 172.21.15.22:0/1432304372 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55614640ed00 con 0x556146464800 2023-07-13T01:39:58.226 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:58 smithi022 bash[53006]: debug 2023-07-13T01:39:58.134+0000 7f8b24f5c640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:39:59.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:39:58 smithi154 bash[27744]: cluster 1689212397.6623492 mgr.a (mgr.14152) 290 : cluster 0 pgmap v205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:59.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:39:58 smithi022 bash[26979]: cluster 1689212397.6623492 mgr.a (mgr.14152) 290 : cluster 0 pgmap v205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:59.039 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:39:58 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:39:59.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:39:58 smithi137 bash[27262]: cluster 1689212397.6623492 mgr.a (mgr.14152) 290 : cluster 0 pgmap v205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:59.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:39:58 smithi103 bash[27315]: cluster 1689212397.6623492 mgr.a (mgr.14152) 290 : cluster 0 pgmap v205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:39:59.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:39:58 smithi084 bash[27323]: cluster 1689212397.6623492 mgr.a (mgr.14152) 290 : cluster 0 pgmap v205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:00.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:00 smithi084 bash[27323]: cluster 1689212399.6628344 mgr.a (mgr.14152) 291 : cluster 0 pgmap v206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:00.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:00 smithi084 bash[27323]: cluster 1689212400.0001264 mon.a (mon.0) 523 : cluster 3 Health detail: HEALTH_WARN 3 failed cephadm daemon(s) 2023-07-13T01:40:00.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:00 smithi084 bash[27323]: cluster 1689212400.0001624 mon.a (mon.0) 524 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2023-07-13T01:40:00.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:00 smithi084 bash[27323]: cluster 1689212400.0001924 mon.a (mon.0) 525 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:40:00.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:00 smithi084 bash[27323]: cluster 1689212400.000216 mon.a (mon.0) 526 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:40:00.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:00 smithi084 bash[27323]: cluster 1689212400.0002542 mon.a (mon.0) 527 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:40:00.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:00 smithi022 bash[26979]: cluster 1689212399.6628344 mgr.a (mgr.14152) 291 : cluster 0 pgmap v206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:00.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:00 smithi022 bash[26979]: cluster 1689212400.0001264 mon.a (mon.0) 523 : cluster 3 Health detail: HEALTH_WARN 3 failed cephadm daemon(s) 2023-07-13T01:40:00.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:00 smithi022 bash[26979]: cluster 1689212400.0001624 mon.a (mon.0) 524 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2023-07-13T01:40:00.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:00 smithi022 bash[26979]: cluster 1689212400.0001924 mon.a (mon.0) 525 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:40:00.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:00 smithi022 bash[26979]: cluster 1689212400.000216 mon.a (mon.0) 526 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:40:00.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:00 smithi022 bash[26979]: cluster 1689212400.0002542 mon.a (mon.0) 527 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:40:00.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:00 smithi154 bash[27744]: cluster 1689212399.6628344 mgr.a (mgr.14152) 291 : cluster 0 pgmap v206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:00.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:00 smithi154 bash[27744]: cluster 1689212400.0001264 mon.a (mon.0) 523 : cluster 3 Health detail: HEALTH_WARN 3 failed cephadm daemon(s) 2023-07-13T01:40:00.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:00 smithi154 bash[27744]: cluster 1689212400.0001624 mon.a (mon.0) 524 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2023-07-13T01:40:00.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:00 smithi154 bash[27744]: cluster 1689212400.0001924 mon.a (mon.0) 525 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:40:00.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:00 smithi154 bash[27744]: cluster 1689212400.000216 mon.a (mon.0) 526 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:40:00.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:00 smithi154 bash[27744]: cluster 1689212400.0002542 mon.a (mon.0) 527 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:40:00.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:00 smithi137 bash[27262]: cluster 1689212399.6628344 mgr.a (mgr.14152) 291 : cluster 0 pgmap v206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:00.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:00 smithi137 bash[27262]: cluster 1689212400.0001264 mon.a (mon.0) 523 : cluster 3 Health detail: HEALTH_WARN 3 failed cephadm daemon(s) 2023-07-13T01:40:00.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:00 smithi137 bash[27262]: cluster 1689212400.0001624 mon.a (mon.0) 524 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2023-07-13T01:40:00.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:00 smithi137 bash[27262]: cluster 1689212400.0001924 mon.a (mon.0) 525 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:40:00.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:00 smithi137 bash[27262]: cluster 1689212400.000216 mon.a (mon.0) 526 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:40:00.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:00 smithi137 bash[27262]: cluster 1689212400.0002542 mon.a (mon.0) 527 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:40:00.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:00 smithi103 bash[27315]: cluster 1689212399.6628344 mgr.a (mgr.14152) 291 : cluster 0 pgmap v206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:00.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:00 smithi103 bash[27315]: cluster 1689212400.0001264 mon.a (mon.0) 523 : cluster 3 Health detail: HEALTH_WARN 3 failed cephadm daemon(s) 2023-07-13T01:40:00.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:00 smithi103 bash[27315]: cluster 1689212400.0001624 mon.a (mon.0) 524 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 3 failed cephadm daemon(s) 2023-07-13T01:40:00.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:00 smithi103 bash[27315]: cluster 1689212400.0001924 mon.a (mon.0) 525 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:40:00.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:00 smithi103 bash[27315]: cluster 1689212400.000216 mon.a (mon.0) 526 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:40:00.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:00 smithi103 bash[27315]: cluster 1689212400.0002542 mon.a (mon.0) 527 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:40:01.412 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:00 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:40:01.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:01 smithi154 bash[27744]: audit 1689212401.4471974 mon.a (mon.0) 528 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-13T01:40:01.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:01 smithi154 bash[27744]: audit 1689212401.4489973 mon.a (mon.0) 529 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:01.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:01 smithi137 bash[27262]: audit 1689212401.4471974 mon.a (mon.0) 528 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-13T01:40:01.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:01 smithi137 bash[27262]: audit 1689212401.4489973 mon.a (mon.0) 529 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:01.813 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:01 smithi084 bash[27323]: audit 1689212401.4471974 mon.a (mon.0) 528 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-13T01:40:01.813 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:01 smithi084 bash[27323]: audit 1689212401.4489973 mon.a (mon.0) 529 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:01.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:01 smithi103 bash[27315]: audit 1689212401.4471974 mon.a (mon.0) 528 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-13T01:40:01.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:01 smithi103 bash[27315]: audit 1689212401.4489973 mon.a (mon.0) 529 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:01.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:01 smithi022 bash[26979]: audit 1689212401.4471974 mon.a (mon.0) 528 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-13T01:40:01.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:01 smithi022 bash[26979]: audit 1689212401.4489973 mon.a (mon.0) 529 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:02.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:02 smithi154 bash[27744]: cephadm 1689212401.4505303 mgr.a (mgr.14152) 292 : cephadm 1 Deploying daemon osd.3 on smithi084 2023-07-13T01:40:02.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:02 smithi154 bash[27744]: cluster 1689212401.6632793 mgr.a (mgr.14152) 293 : cluster 0 pgmap v207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:02.804 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:02 smithi084 bash[27323]: cephadm 1689212401.4505303 mgr.a (mgr.14152) 292 : cephadm 1 Deploying daemon osd.3 on smithi084 2023-07-13T01:40:02.804 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:02 smithi084 bash[27323]: cluster 1689212401.6632793 mgr.a (mgr.14152) 293 : cluster 0 pgmap v207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:02.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:02 smithi137 bash[27262]: cephadm 1689212401.4505303 mgr.a (mgr.14152) 292 : cephadm 1 Deploying daemon osd.3 on smithi084 2023-07-13T01:40:02.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:02 smithi137 bash[27262]: cluster 1689212401.6632793 mgr.a (mgr.14152) 293 : cluster 0 pgmap v207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:02.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:02 smithi103 bash[27315]: cephadm 1689212401.4505303 mgr.a (mgr.14152) 292 : cephadm 1 Deploying daemon osd.3 on smithi084 2023-07-13T01:40:02.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:02 smithi103 bash[27315]: cluster 1689212401.6632793 mgr.a (mgr.14152) 293 : cluster 0 pgmap v207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:02.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:02 smithi022 bash[26979]: cephadm 1689212401.4505303 mgr.a (mgr.14152) 292 : cephadm 1 Deploying daemon osd.3 on smithi084 2023-07-13T01:40:02.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:02 smithi022 bash[26979]: cluster 1689212401.6632793 mgr.a (mgr.14152) 293 : cluster 0 pgmap v207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:04.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:04 smithi084 bash[27323]: cluster 1689212403.6637228 mgr.a (mgr.14152) 294 : cluster 0 pgmap v208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:05.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:04 smithi154 bash[27744]: cluster 1689212403.6637228 mgr.a (mgr.14152) 294 : cluster 0 pgmap v208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:05.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:04 smithi137 bash[27262]: cluster 1689212403.6637228 mgr.a (mgr.14152) 294 : cluster 0 pgmap v208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:05.109 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:04 smithi103 bash[27315]: cluster 1689212403.6637228 mgr.a (mgr.14152) 294 : cluster 0 pgmap v208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:05.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:04 smithi022 bash[26979]: cluster 1689212403.6637228 mgr.a (mgr.14152) 294 : cluster 0 pgmap v208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:05.163 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:04 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 10. 2023-07-13T01:40:05.163 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:04 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:05.163 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:04 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:06.412 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:05 smithi022 bash[53314]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:06.412 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:05 smithi022 bash[53314]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:06.412 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:05 smithi022 bash[53314]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:06.413 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:05 smithi022 bash[53314]: --> Failed to activate any OSD(s) 2023-07-13T01:40:07.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:07 smithi084 bash[27323]: cluster 1689212405.6642113 mgr.a (mgr.14152) 295 : cluster 0 pgmap v209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:07.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:07 smithi084 bash[27323]: audit 1689212406.1338766 mon.a (mon.0) 530 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:07 smithi084 bash[27323]: audit 1689212406.140288 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:07 smithi084 bash[27323]: audit 1689212406.1743307 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:07.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:07 smithi022 bash[26979]: cluster 1689212405.6642113 mgr.a (mgr.14152) 295 : cluster 0 pgmap v209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:07.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:07 smithi022 bash[26979]: audit 1689212406.1338766 mon.a (mon.0) 530 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:07 smithi022 bash[26979]: audit 1689212406.140288 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:07 smithi022 bash[26979]: audit 1689212406.1743307 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:07.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:07 smithi154 bash[27744]: cluster 1689212405.6642113 mgr.a (mgr.14152) 295 : cluster 0 pgmap v209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:07.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:07 smithi154 bash[27744]: audit 1689212406.1338766 mon.a (mon.0) 530 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:07 smithi154 bash[27744]: audit 1689212406.140288 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:07 smithi154 bash[27744]: audit 1689212406.1743307 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:07.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:07 smithi137 bash[27262]: cluster 1689212405.6642113 mgr.a (mgr.14152) 295 : cluster 0 pgmap v209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:07.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:07 smithi137 bash[27262]: audit 1689212406.1338766 mon.a (mon.0) 530 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:07 smithi137 bash[27262]: audit 1689212406.140288 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:07 smithi137 bash[27262]: audit 1689212406.1743307 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:07.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:07 smithi103 bash[27315]: cluster 1689212405.6642113 mgr.a (mgr.14152) 295 : cluster 0 pgmap v209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:07.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:07 smithi103 bash[27315]: audit 1689212406.1338766 mon.a (mon.0) 530 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:07 smithi103 bash[27315]: audit 1689212406.140288 mon.a (mon.0) 531 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:07.610 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:07 smithi103 bash[27315]: audit 1689212406.1743307 mon.a (mon.0) 532 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:07.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:07 smithi022 bash[53416]: debug 2023-07-13T01:40:07.750+0000 7f80c9e36700 1 -- 172.21.15.22:0/2315951327 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9b7268d00 con 0x55d9b72bf000 2023-07-13T01:40:07.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:07 smithi022 bash[53416]: debug 2023-07-13T01:40:07.750+0000 7f80d2fbb640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:08.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:07 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:40:08.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:07 smithi022 systemd[1]: Stopped Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:08.413 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:07 smithi022 systemd[1]: Started Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:09.132 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:08 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:09.310 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:09 smithi084 bash[27323]: cluster 1689212407.6646726 mgr.a (mgr.14152) 296 : cluster 0 pgmap v210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:09.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:09 smithi022 bash[26979]: cluster 1689212407.6646726 mgr.a (mgr.14152) 296 : cluster 0 pgmap v210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:09.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:09 smithi154 bash[27744]: cluster 1689212407.6646726 mgr.a (mgr.14152) 296 : cluster 0 pgmap v210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:09.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:09 smithi137 bash[27262]: cluster 1689212407.6646726 mgr.a (mgr.14152) 296 : cluster 0 pgmap v210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:09.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:09 smithi103 bash[27315]: cluster 1689212407.6646726 mgr.a (mgr.14152) 296 : cluster 0 pgmap v210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:10.467 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:10 smithi022 bash[53528]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:10.468 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:10 smithi022 bash[53528]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:10.468 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:10 smithi022 bash[53528]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:10.468 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:10 smithi022 bash[53528]: --> Failed to activate any OSD(s) 2023-07-13T01:40:10.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:10 smithi022 bash[26979]: cluster 1689212409.664999 mgr.a (mgr.14152) 297 : cluster 0 pgmap v211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:10.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:10 smithi154 bash[27744]: cluster 1689212409.664999 mgr.a (mgr.14152) 297 : cluster 0 pgmap v211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:10.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:10 smithi137 bash[27262]: cluster 1689212409.664999 mgr.a (mgr.14152) 297 : cluster 0 pgmap v211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:10.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:10 smithi103 bash[27315]: cluster 1689212409.664999 mgr.a (mgr.14152) 297 : cluster 0 pgmap v211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:10.864 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:10 smithi084 bash[27323]: cluster 1689212409.664999 mgr.a (mgr.14152) 297 : cluster 0 pgmap v211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:11.352 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:11 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:40:11.353 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:11 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:11.353 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:11 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:12.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: audit 1689212411.4093544 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: audit 1689212411.4158406 mon.a (mon.0) 534 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: cluster 1689212411.6652687 mgr.a (mgr.14152) 298 : cluster 0 pgmap v212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: audit 1689212411.8371363 mon.a (mon.0) 535 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:12.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: audit 1689212411.8381248 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:12.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: cluster 1689212411.8400733 mgr.a (mgr.14152) 299 : cluster 0 pgmap v213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: cluster 1689212411.8401973 mgr.a (mgr.14152) 300 : cluster 0 pgmap v214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:12 smithi084 bash[27323]: audit 1689212411.8458176 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.662 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:12 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:40:12.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: audit 1689212411.4093544 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: audit 1689212411.4158406 mon.a (mon.0) 534 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: cluster 1689212411.6652687 mgr.a (mgr.14152) 298 : cluster 0 pgmap v212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: audit 1689212411.8371363 mon.a (mon.0) 535 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: audit 1689212411.8381248 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: cluster 1689212411.8400733 mgr.a (mgr.14152) 299 : cluster 0 pgmap v213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: cluster 1689212411.8401973 mgr.a (mgr.14152) 300 : cluster 0 pgmap v214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[26979]: audit 1689212411.8458176 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: audit 1689212411.4093544 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: audit 1689212411.4158406 mon.a (mon.0) 534 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: cluster 1689212411.6652687 mgr.a (mgr.14152) 298 : cluster 0 pgmap v212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: audit 1689212411.8371363 mon.a (mon.0) 535 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:12.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: audit 1689212411.8381248 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:12.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: cluster 1689212411.8400733 mgr.a (mgr.14152) 299 : cluster 0 pgmap v213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: cluster 1689212411.8401973 mgr.a (mgr.14152) 300 : cluster 0 pgmap v214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:12 smithi154 bash[27744]: audit 1689212411.8458176 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: audit 1689212411.4093544 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: audit 1689212411.4158406 mon.a (mon.0) 534 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: cluster 1689212411.6652687 mgr.a (mgr.14152) 298 : cluster 0 pgmap v212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: audit 1689212411.8371363 mon.a (mon.0) 535 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:12.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: audit 1689212411.8381248 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:12.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: cluster 1689212411.8400733 mgr.a (mgr.14152) 299 : cluster 0 pgmap v213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: cluster 1689212411.8401973 mgr.a (mgr.14152) 300 : cluster 0 pgmap v214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:12 smithi137 bash[27262]: audit 1689212411.8458176 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: audit 1689212411.4093544 mon.a (mon.0) 533 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: audit 1689212411.4158406 mon.a (mon.0) 534 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:12.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: cluster 1689212411.6652687 mgr.a (mgr.14152) 298 : cluster 0 pgmap v212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: audit 1689212411.8371363 mon.a (mon.0) 535 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:12.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: audit 1689212411.8381248 mon.a (mon.0) 536 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:12.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: cluster 1689212411.8400733 mgr.a (mgr.14152) 299 : cluster 0 pgmap v213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: cluster 1689212411.8401973 mgr.a (mgr.14152) 300 : cluster 0 pgmap v214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:12.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:12 smithi103 bash[27315]: audit 1689212411.8458176 mon.a (mon.0) 537 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:13.162 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[53816]: debug 2023-07-13T01:40:12.929+0000 7ff12f638700 1 -- 172.21.15.22:0/3634424016 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b54bf2ad00 con 0x55b54bf80c00 2023-07-13T01:40:13.162 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:12 smithi022 bash[53816]: debug 2023-07-13T01:40:12.933+0000 7ff1387bd640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:13.430 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:13 smithi022 bash[53782]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:13.430 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:13 smithi022 bash[53782]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:13.431 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:13 smithi022 bash[53782]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:13.431 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:13 smithi022 bash[53782]: --> Failed to activate any OSD(s) 2023-07-13T01:40:13.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:13 smithi084 bash[27323]: cluster 1689212412.4128208 mon.a (mon.0) 538 : cluster 3 Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:40:13.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:13 smithi154 bash[27744]: cluster 1689212412.4128208 mon.a (mon.0) 538 : cluster 3 Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:40:13.784 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:13 smithi022 bash[26979]: cluster 1689212412.4128208 mon.a (mon.0) 538 : cluster 3 Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:40:13.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:13 smithi137 bash[27262]: cluster 1689212412.4128208 mon.a (mon.0) 538 : cluster 3 Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:40:13.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:13 smithi103 bash[27315]: cluster 1689212412.4128208 mon.a (mon.0) 538 : cluster 3 Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:40:14.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:14 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:14.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:14 smithi022 bash[26979]: cluster 1689212413.8406105 mgr.a (mgr.14152) 301 : cluster 0 pgmap v215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:14.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:14 smithi154 bash[27744]: cluster 1689212413.8406105 mgr.a (mgr.14152) 301 : cluster 0 pgmap v215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:14.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:14 smithi137 bash[27262]: cluster 1689212413.8406105 mgr.a (mgr.14152) 301 : cluster 0 pgmap v215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:14.825 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:14 smithi084 bash[27323]: cluster 1689212413.8406105 mgr.a (mgr.14152) 301 : cluster 0 pgmap v215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:14.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:14 smithi103 bash[27315]: cluster 1689212413.8406105 mgr.a (mgr.14152) 301 : cluster 0 pgmap v215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:15.537 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 3 on host 'smithi084' 2023-07-13T01:40:16.145 DEBUG:teuthology.orchestra.run.smithi084:osd.3> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service 2023-07-13T01:40:16.147 INFO:tasks.cephadm:Deploying osd.4 on smithi084 with /dev/vg_nvme/lv_3... 2023-07-13T01:40:16.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-13T01:40:16.162 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:16 smithi022 bash[54070]: debug 2023-07-13T01:40:16.005+0000 7fa369393700 1 -- 172.21.15.22:0/2584975440 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56392e484d00 con 0x56392e4da800 2023-07-13T01:40:16.162 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:16 smithi022 bash[54070]: debug 2023-07-13T01:40:16.009+0000 7fa372518640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:16.459 INFO:journalctl@ceph.osd.3.smithi084.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:40:16.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:16 smithi022 bash[26979]: audit 1689212415.4844828 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:16 smithi022 bash[26979]: audit 1689212415.4850073 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:16.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:16 smithi022 bash[26979]: audit 1689212415.4936574 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:16 smithi022 bash[26979]: cluster 1689212415.8411534 mgr.a (mgr.14152) 302 : cluster 0 pgmap v216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:16.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:16 smithi154 bash[27744]: audit 1689212415.4844828 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:16 smithi154 bash[27744]: audit 1689212415.4850073 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:16.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:16 smithi154 bash[27744]: audit 1689212415.4936574 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:16 smithi154 bash[27744]: cluster 1689212415.8411534 mgr.a (mgr.14152) 302 : cluster 0 pgmap v216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:16.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:16 smithi137 bash[27262]: audit 1689212415.4844828 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:16 smithi137 bash[27262]: audit 1689212415.4850073 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:16.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:16 smithi137 bash[27262]: audit 1689212415.4936574 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:16 smithi137 bash[27262]: cluster 1689212415.8411534 mgr.a (mgr.14152) 302 : cluster 0 pgmap v216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:16.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:16 smithi103 bash[27315]: audit 1689212415.4844828 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:16 smithi103 bash[27315]: audit 1689212415.4850073 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:16.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:16 smithi103 bash[27315]: audit 1689212415.4936574 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:16 smithi103 bash[27315]: cluster 1689212415.8411534 mgr.a (mgr.14152) 302 : cluster 0 pgmap v216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:16.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:16 smithi084 bash[27323]: audit 1689212415.4844828 mon.a (mon.0) 539 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:16 smithi084 bash[27323]: audit 1689212415.4850073 mon.a (mon.0) 540 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:40:16.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:16 smithi084 bash[27323]: audit 1689212415.4936574 mon.a (mon.0) 541 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:16.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:16 smithi084 bash[27323]: cluster 1689212415.8411534 mgr.a (mgr.14152) 302 : cluster 0 pgmap v216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:17.411 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:17 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:17.662 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:17 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2023-07-13T01:40:19.148 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:18 smithi084 bash[27323]: cluster 1689212417.8416476 mgr.a (mgr.14152) 303 : cluster 0 pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:19.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:18 smithi022 bash[26979]: cluster 1689212417.8416476 mgr.a (mgr.14152) 303 : cluster 0 pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:19.262 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:18 smithi154 bash[27744]: cluster 1689212417.8416476 mgr.a (mgr.14152) 303 : cluster 0 pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:19.310 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:18 smithi137 bash[27262]: cluster 1689212417.8416476 mgr.a (mgr.14152) 303 : cluster 0 pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:19.358 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:18 smithi103 bash[27315]: cluster 1689212417.8416476 mgr.a (mgr.14152) 303 : cluster 0 pgmap v217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:19.662 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:19 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:40:20.345 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.b/config 2023-07-13T01:40:20.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:20 smithi084 bash[27323]: cluster 1689212419.8421052 mgr.a (mgr.14152) 304 : cluster 0 pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:20.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:20 smithi154 bash[27744]: cluster 1689212419.8421052 mgr.a (mgr.14152) 304 : cluster 0 pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:20.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:20 smithi137 bash[27262]: cluster 1689212419.8421052 mgr.a (mgr.14152) 304 : cluster 0 pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:20.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:20 smithi103 bash[27315]: cluster 1689212419.8421052 mgr.a (mgr.14152) 304 : cluster 0 pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:20.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:20 smithi022 bash[26979]: cluster 1689212419.8421052 mgr.a (mgr.14152) 304 : cluster 0 pgmap v218: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:22.894 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:22 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 11. 2023-07-13T01:40:22.894 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:22 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:22.894 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:22 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:22.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:22 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:40:22.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:22 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:22.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:22 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:23.148 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:22 smithi084 bash[27323]: cluster 1689212421.8425941 mgr.a (mgr.14152) 305 : cluster 0 pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:23.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:22 smithi022 bash[26979]: cluster 1689212421.8425941 mgr.a (mgr.14152) 305 : cluster 0 pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:23.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:22 smithi154 bash[27744]: cluster 1689212421.8425941 mgr.a (mgr.14152) 305 : cluster 0 pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:23.310 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:22 smithi137 bash[27262]: cluster 1689212421.8425941 mgr.a (mgr.14152) 305 : cluster 0 pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:23.358 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:22 smithi103 bash[27315]: cluster 1689212421.8425941 mgr.a (mgr.14152) 305 : cluster 0 pgmap v219: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:24.162 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:23 smithi022 bash[54398]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:24.162 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:23 smithi022 bash[54398]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:24.162 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:23 smithi022 bash[54398]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:24.162 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:23 smithi022 bash[54398]: --> Failed to activate any OSD(s) 2023-07-13T01:40:24.978 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:24 smithi084 bash[27323]: cluster 1689212423.8430347 mgr.a (mgr.14152) 306 : cluster 0 pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:25.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:24 smithi022 bash[26979]: cluster 1689212423.8430347 mgr.a (mgr.14152) 306 : cluster 0 pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:25.242 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:24 smithi084 bash[31552]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:25.243 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:24 smithi084 bash[31552]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:25.243 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:24 smithi084 bash[31552]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:25.243 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:24 smithi084 bash[31552]: --> Failed to activate any OSD(s) 2023-07-13T01:40:25.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:24 smithi154 bash[27744]: cluster 1689212423.8430347 mgr.a (mgr.14152) 306 : cluster 0 pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:25.309 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:24 smithi137 bash[27262]: cluster 1689212423.8430347 mgr.a (mgr.14152) 306 : cluster 0 pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:25.358 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:24 smithi103 bash[27315]: cluster 1689212423.8430347 mgr.a (mgr.14152) 306 : cluster 0 pgmap v220: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:25.662 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:25 smithi022 bash[54503]: debug 2023-07-13T01:40:25.557+0000 7f003422b700 1 -- 172.21.15.22:0/4151969136 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55698840ed00 con 0x556988465000 2023-07-13T01:40:25.662 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:25 smithi022 bash[54503]: debug 2023-07-13T01:40:25.557+0000 7f003d3b0640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:25.855 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-13T01:40:25.856 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-13T01:40:25.856 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2023-07-13T01:40:25.856 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2023-07-13T01:40:25.856 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134408 s, 780 MB/s 2023-07-13T01:40:25.857 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2023-07-13T01:40:26.662 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:26 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:27.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:26 smithi022 bash[26979]: cluster 1689212425.8434544 mgr.a (mgr.14152) 307 : cluster 0 pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:27.230 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:26 smithi084 bash[27323]: cluster 1689212425.8434544 mgr.a (mgr.14152) 307 : cluster 0 pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:27.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2023-07-13T01:40:27.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:26 smithi154 bash[27744]: cluster 1689212425.8434544 mgr.a (mgr.14152) 307 : cluster 0 pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:27.310 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:26 smithi137 bash[27262]: cluster 1689212425.8434544 mgr.a (mgr.14152) 307 : cluster 0 pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:27.358 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:26 smithi103 bash[27315]: cluster 1689212425.8434544 mgr.a (mgr.14152) 307 : cluster 0 pgmap v221: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:27.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:27 smithi084 bash[32568]: debug 2023-07-13T01:40:27.504+0000 7f54b9af2700 1 -- 172.21.15.84:0/622167933 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560c9ef10d00 con 0x560c9ef67000 2023-07-13T01:40:27.899 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:27 smithi084 bash[32568]: debug 2023-07-13T01:40:27.508+0000 7f54c2c77640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:28.119 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:27 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:40:28.120 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:27 smithi022 systemd[1]: Stopped Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:28.120 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:27 smithi022 systemd[1]: Started Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:28.359 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: cephadm 1689212427.0995193 mgr.a (mgr.14152) 308 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:40:28.359 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.1094162 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.359 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.115969 mon.a (mon.0) 543 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.359 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.117218 mon.a (mon.0) 544 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:40:28.359 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: cephadm 1689212427.1181588 mgr.a (mgr.14152) 309 : cephadm 1 Adjusting osd_memory_target on smithi084 to 17265M 2023-07-13T01:40:28.359 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.123685 mon.a (mon.0) 545 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.1253703 mon.a (mon.0) 546 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:28.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.1265876 mon.a (mon.0) 547 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:28.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: cluster 1689212427.1292446 mgr.a (mgr.14152) 310 : cluster 0 pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: cluster 1689212427.1295002 mgr.a (mgr.14152) 311 : cluster 0 pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.360 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:28 smithi103 bash[27315]: audit 1689212427.1357696 mon.a (mon.0) 548 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.398 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:28 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:28.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: cephadm 1689212427.0995193 mgr.a (mgr.14152) 308 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:40:28.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.1094162 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.115969 mon.a (mon.0) 543 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.117218 mon.a (mon.0) 544 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:40:28.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: cephadm 1689212427.1181588 mgr.a (mgr.14152) 309 : cephadm 1 Adjusting osd_memory_target on smithi084 to 17265M 2023-07-13T01:40:28.399 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.123685 mon.a (mon.0) 545 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.400 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.1253703 mon.a (mon.0) 546 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:28.400 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.1265876 mon.a (mon.0) 547 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:28.400 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: cluster 1689212427.1292446 mgr.a (mgr.14152) 310 : cluster 0 pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.400 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: cluster 1689212427.1295002 mgr.a (mgr.14152) 311 : cluster 0 pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.400 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:28 smithi084 bash[27323]: audit 1689212427.1357696 mon.a (mon.0) 548 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: cephadm 1689212427.0995193 mgr.a (mgr.14152) 308 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:40:28.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.1094162 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.115969 mon.a (mon.0) 543 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.117218 mon.a (mon.0) 544 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: cephadm 1689212427.1181588 mgr.a (mgr.14152) 309 : cephadm 1 Adjusting osd_memory_target on smithi084 to 17265M 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.123685 mon.a (mon.0) 545 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.1253703 mon.a (mon.0) 546 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.1265876 mon.a (mon.0) 547 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: cluster 1689212427.1292446 mgr.a (mgr.14152) 310 : cluster 0 pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: cluster 1689212427.1295002 mgr.a (mgr.14152) 311 : cluster 0 pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:28 smithi022 bash[26979]: audit 1689212427.1357696 mon.a (mon.0) 548 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: cephadm 1689212427.0995193 mgr.a (mgr.14152) 308 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:40:28.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.1094162 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.115969 mon.a (mon.0) 543 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.512 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.117218 mon.a (mon.0) 544 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: cephadm 1689212427.1181588 mgr.a (mgr.14152) 309 : cephadm 1 Adjusting osd_memory_target on smithi084 to 17265M 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.123685 mon.a (mon.0) 545 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.1253703 mon.a (mon.0) 546 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.1265876 mon.a (mon.0) 547 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: cluster 1689212427.1292446 mgr.a (mgr.14152) 310 : cluster 0 pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: cluster 1689212427.1295002 mgr.a (mgr.14152) 311 : cluster 0 pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.513 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:28 smithi154 bash[27744]: audit 1689212427.1357696 mon.a (mon.0) 548 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: cephadm 1689212427.0995193 mgr.a (mgr.14152) 308 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:40:28.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.1094162 mon.a (mon.0) 542 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.115969 mon.a (mon.0) 543 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.117218 mon.a (mon.0) 544 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:40:28.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: cephadm 1689212427.1181588 mgr.a (mgr.14152) 309 : cephadm 1 Adjusting osd_memory_target on smithi084 to 17265M 2023-07-13T01:40:28.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.123685 mon.a (mon.0) 545 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:28.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.1253703 mon.a (mon.0) 546 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:28.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.1265876 mon.a (mon.0) 547 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:40:28.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: cluster 1689212427.1292446 mgr.a (mgr.14152) 310 : cluster 0 pgmap v222: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: cluster 1689212427.1295002 mgr.a (mgr.14152) 311 : cluster 0 pgmap v223: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:28.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:28 smithi137 bash[27262]: audit 1689212427.1357696 mon.a (mon.0) 548 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:40:29.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:29 smithi022 bash[26979]: cluster 1689212429.1299524 mgr.a (mgr.14152) 312 : cluster 0 pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:29.412 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:29 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:40:29.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:29 smithi154 bash[27744]: cluster 1689212429.1299524 mgr.a (mgr.14152) 312 : cluster 0 pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:29.560 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:29 smithi137 bash[27262]: cluster 1689212429.1299524 mgr.a (mgr.14152) 312 : cluster 0 pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:29.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:29 smithi103 bash[27315]: cluster 1689212429.1299524 mgr.a (mgr.14152) 312 : cluster 0 pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:29.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:29 smithi084 bash[27323]: cluster 1689212429.1299524 mgr.a (mgr.14152) 312 : cluster 0 pgmap v224: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:29.685 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:29 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:40:29.732 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:29 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:29.733 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:29 smithi022 systemd[1]: Started Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:29.769 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:29 smithi022 bash[54739]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:29.769 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:29 smithi022 bash[54739]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:29.769 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:29 smithi022 bash[54739]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:29.770 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:29 smithi022 bash[54739]: --> Failed to activate any OSD(s) 2023-07-13T01:40:30.648 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:30 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:40:31.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:31 smithi022 bash[26979]: cluster 1689212431.1304467 mgr.a (mgr.14152) 313 : cluster 0 pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:31.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:31 smithi154 bash[27744]: cluster 1689212431.1304467 mgr.a (mgr.14152) 313 : cluster 0 pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:31.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:31 smithi137 bash[27262]: cluster 1689212431.1304467 mgr.a (mgr.14152) 313 : cluster 0 pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:31.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:31 smithi103 bash[27315]: cluster 1689212431.1304467 mgr.a (mgr.14152) 313 : cluster 0 pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:31.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:31 smithi084 bash[27323]: cluster 1689212431.1304467 mgr.a (mgr.14152) 313 : cluster 0 pgmap v225: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.b/config 2023-07-13T01:40:31.912 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:31 smithi022 bash[54842]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:31.912 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:31 smithi022 bash[54842]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:31.912 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:31 smithi022 bash[54842]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:31.912 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:31 smithi022 bash[54842]: --> Failed to activate any OSD(s) 2023-07-13T01:40:32.523 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:32 smithi022 bash[54912]: debug 2023-07-13T01:40:32.365+0000 7fe60dece700 1 -- 172.21.15.22:0/795166041 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557604db8d00 con 0x557604e0e800 2023-07-13T01:40:32.523 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:32 smithi022 bash[54912]: debug 2023-07-13T01:40:32.365+0000 7fe617053640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:33.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:33 smithi022 bash[26979]: cluster 1689212433.1309743 mgr.a (mgr.14152) 314 : cluster 0 pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:33.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:33 smithi154 bash[27744]: cluster 1689212433.1309743 mgr.a (mgr.14152) 314 : cluster 0 pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:33.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:33 smithi137 bash[27262]: cluster 1689212433.1309743 mgr.a (mgr.14152) 314 : cluster 0 pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:33.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:33 smithi103 bash[27315]: cluster 1689212433.1309743 mgr.a (mgr.14152) 314 : cluster 0 pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:33.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:33 smithi084 bash[27323]: cluster 1689212433.1309743 mgr.a (mgr.14152) 314 : cluster 0 pgmap v226: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:34.020 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:33 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:34.162 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:34 smithi022 bash[55063]: debug 2023-07-13T01:40:34.021+0000 7efe1f4f5700 1 -- 172.21.15.22:0/373230939 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bcd3600d00 con 0x55bcd3656800 2023-07-13T01:40:34.162 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:34 smithi022 bash[55063]: debug 2023-07-13T01:40:34.021+0000 7efe2867a640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:35.411 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:35 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:35.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:35 smithi022 bash[26979]: audit 1689212434.9875479 mgr.a (mgr.14152) 315 : audit 0 from='client.14435 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:40:35.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:35 smithi022 bash[26979]: audit 1689212434.9912913 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:40:35.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:35 smithi022 bash[26979]: audit 1689212434.99468 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:40:35.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:35 smithi022 bash[26979]: audit 1689212434.9957595 mon.a (mon.0) 551 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:35.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:35 smithi022 bash[26979]: cluster 1689212435.1314688 mgr.a (mgr.14152) 316 : cluster 0 pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:35.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:35 smithi154 bash[27744]: audit 1689212434.9875479 mgr.a (mgr.14152) 315 : audit 0 from='client.14435 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:40:35.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:35 smithi154 bash[27744]: audit 1689212434.9912913 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:40:35.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:35 smithi154 bash[27744]: audit 1689212434.99468 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:40:35.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:35 smithi154 bash[27744]: audit 1689212434.9957595 mon.a (mon.0) 551 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:35.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:35 smithi154 bash[27744]: cluster 1689212435.1314688 mgr.a (mgr.14152) 316 : cluster 0 pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:35.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:35 smithi137 bash[27262]: audit 1689212434.9875479 mgr.a (mgr.14152) 315 : audit 0 from='client.14435 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:40:35.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:35 smithi137 bash[27262]: audit 1689212434.9912913 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:40:35.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:35 smithi137 bash[27262]: audit 1689212434.99468 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:40:35.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:35 smithi137 bash[27262]: audit 1689212434.9957595 mon.a (mon.0) 551 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:35.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:35 smithi137 bash[27262]: cluster 1689212435.1314688 mgr.a (mgr.14152) 316 : cluster 0 pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:35.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:35 smithi103 bash[27315]: audit 1689212434.9875479 mgr.a (mgr.14152) 315 : audit 0 from='client.14435 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:40:35.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:35 smithi103 bash[27315]: audit 1689212434.9912913 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:40:35.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:35 smithi103 bash[27315]: audit 1689212434.99468 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:40:35.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:35 smithi103 bash[27315]: audit 1689212434.9957595 mon.a (mon.0) 551 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:35.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:35 smithi103 bash[27315]: cluster 1689212435.1314688 mgr.a (mgr.14152) 316 : cluster 0 pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:35.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:35 smithi084 bash[27323]: audit 1689212434.9875479 mgr.a (mgr.14152) 315 : audit 0 from='client.14435 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:40:35.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:35 smithi084 bash[27323]: audit 1689212434.9912913 mon.a (mon.0) 549 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:40:35.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:35 smithi084 bash[27323]: audit 1689212434.99468 mon.a (mon.0) 550 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:40:35.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:35 smithi084 bash[27323]: audit 1689212434.9957595 mon.a (mon.0) 551 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:35.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:35 smithi084 bash[27323]: cluster 1689212435.1314688 mgr.a (mgr.14152) 316 : cluster 0 pgmap v227: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:37.161 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:36 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2023-07-13T01:40:37.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:37 smithi154 bash[27744]: cluster 1689212437.1319017 mgr.a (mgr.14152) 317 : cluster 0 pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:37.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:37 smithi022 bash[26979]: cluster 1689212437.1319017 mgr.a (mgr.14152) 317 : cluster 0 pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:37.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:37 smithi137 bash[27262]: cluster 1689212437.1319017 mgr.a (mgr.14152) 317 : cluster 0 pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:37.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:37 smithi103 bash[27315]: cluster 1689212437.1319017 mgr.a (mgr.14152) 317 : cluster 0 pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:37.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:37 smithi084 bash[27323]: cluster 1689212437.1319017 mgr.a (mgr.14152) 317 : cluster 0 pgmap v228: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:38.411 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:38 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:40:39.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:39 smithi154 bash[27744]: cluster 1689212439.1323483 mgr.a (mgr.14152) 318 : cluster 0 pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:39.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:39 smithi137 bash[27262]: cluster 1689212439.1323483 mgr.a (mgr.14152) 318 : cluster 0 pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:39.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:39 smithi103 bash[27315]: cluster 1689212439.1323483 mgr.a (mgr.14152) 318 : cluster 0 pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:39.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:39 smithi084 bash[27323]: cluster 1689212439.1323483 mgr.a (mgr.14152) 318 : cluster 0 pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:39.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:39 smithi022 bash[26979]: cluster 1689212439.1323483 mgr.a (mgr.14152) 318 : cluster 0 pgmap v229: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:39.662 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:39 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 12. 2023-07-13T01:40:39.663 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:39 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:39.663 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:39 smithi022 systemd[1]: Started Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:40.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:40 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:40:40.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:40 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:40.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:40 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:40.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:40 smithi022 bash[55492]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:40.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:40 smithi022 bash[55492]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:40.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:40 smithi022 bash[55492]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:40.913 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:40 smithi022 bash[55492]: --> Failed to activate any OSD(s) 2023-07-13T01:40:41.492 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:41 smithi084 bash[27323]: cluster 1689212441.1327968 mgr.a (mgr.14152) 319 : cluster 0 pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:41.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:41 smithi154 bash[27744]: cluster 1689212441.1327968 mgr.a (mgr.14152) 319 : cluster 0 pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:41.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:41 smithi137 bash[27262]: cluster 1689212441.1327968 mgr.a (mgr.14152) 319 : cluster 0 pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:41.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:41 smithi103 bash[27315]: cluster 1689212441.1327968 mgr.a (mgr.14152) 319 : cluster 0 pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:41.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:41 smithi022 bash[26979]: cluster 1689212441.1327968 mgr.a (mgr.14152) 319 : cluster 0 pgmap v230: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:42.371 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:42 smithi084 bash[33095]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:42.372 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:42 smithi084 bash[33095]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:42.372 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:42 smithi084 bash[33095]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:42.372 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:42 smithi084 bash[33095]: --> Failed to activate any OSD(s) 2023-07-13T01:40:42.566 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:42 smithi022 bash[55596]: debug 2023-07-13T01:40:42.349+0000 7f925663b700 1 -- 172.21.15.22:0/1946837919 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e3811e4d00 con 0x55e38123b000 2023-07-13T01:40:42.566 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:42 smithi022 bash[55596]: debug 2023-07-13T01:40:42.349+0000 7f925f7c0640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:43.398 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:43 smithi084 bash[27323]: cluster 1689212443.1332216 mgr.a (mgr.14152) 320 : cluster 0 pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:43.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:43 smithi022 bash[26979]: cluster 1689212443.1332216 mgr.a (mgr.14152) 320 : cluster 0 pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:43.412 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:43 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:43.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:43 smithi154 bash[27744]: cluster 1689212443.1332216 mgr.a (mgr.14152) 320 : cluster 0 pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:43.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:43 smithi137 bash[27262]: cluster 1689212443.1332216 mgr.a (mgr.14152) 320 : cluster 0 pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:43.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:43 smithi103 bash[27315]: cluster 1689212443.1332216 mgr.a (mgr.14152) 320 : cluster 0 pgmap v231: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:44.611 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:44 smithi084 bash[33283]: debug 2023-07-13T01:40:44.427+0000 7f45f00db700 1 -- 172.21.15.84:0/3546860230 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ff8a388d00 con 0x55ff8a3dec00 2023-07-13T01:40:44.611 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:44 smithi084 bash[33283]: debug 2023-07-13T01:40:44.431+0000 7f45f9260640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:40:45.398 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:45 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:40:45.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.0739841 mon.a (mon.0) 552 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]: dispatch 2023-07-13T01:40:45.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.0837338 mon.a (mon.0) 553 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]': finished 2023-07-13T01:40:45.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: cluster 1689212445.0838025 mon.a (mon.0) 554 : cluster 0 osdmap e9: 5 total, 0 up, 5 in 2023-07-13T01:40:45.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.0839627 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:40:45.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.0846639 mon.a (mon.0) 556 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:40:45.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.084972 mon.a (mon.0) 557 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:40:45.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.0853364 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:40:45.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: audit 1689212445.0856478 mon.a (mon.0) 559 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:40:45.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:45 smithi084 bash[27323]: cluster 1689212445.1336894 mgr.a (mgr.14152) 321 : cluster 0 pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:45.661 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:45 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:40:45.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.0739841 mon.a (mon.0) 552 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]: dispatch 2023-07-13T01:40:45.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.0837338 mon.a (mon.0) 553 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]': finished 2023-07-13T01:40:45.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: cluster 1689212445.0838025 mon.a (mon.0) 554 : cluster 0 osdmap e9: 5 total, 0 up, 5 in 2023-07-13T01:40:45.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.0839627 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:40:45.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.0846639 mon.a (mon.0) 556 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:40:45.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.084972 mon.a (mon.0) 557 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:40:45.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.0853364 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:40:45.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: audit 1689212445.0856478 mon.a (mon.0) 559 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:40:45.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:45 smithi022 bash[26979]: cluster 1689212445.1336894 mgr.a (mgr.14152) 321 : cluster 0 pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:45.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.0739841 mon.a (mon.0) 552 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]: dispatch 2023-07-13T01:40:45.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.0837338 mon.a (mon.0) 553 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]': finished 2023-07-13T01:40:45.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: cluster 1689212445.0838025 mon.a (mon.0) 554 : cluster 0 osdmap e9: 5 total, 0 up, 5 in 2023-07-13T01:40:45.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.0839627 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:40:45.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.0846639 mon.a (mon.0) 556 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:40:45.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.084972 mon.a (mon.0) 557 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:40:45.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.0853364 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:40:45.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: audit 1689212445.0856478 mon.a (mon.0) 559 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:40:45.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:45 smithi154 bash[27744]: cluster 1689212445.1336894 mgr.a (mgr.14152) 321 : cluster 0 pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:45.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.0739841 mon.a (mon.0) 552 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]: dispatch 2023-07-13T01:40:45.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.0837338 mon.a (mon.0) 553 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]': finished 2023-07-13T01:40:45.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: cluster 1689212445.0838025 mon.a (mon.0) 554 : cluster 0 osdmap e9: 5 total, 0 up, 5 in 2023-07-13T01:40:45.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.0839627 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:40:45.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.0846639 mon.a (mon.0) 556 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:40:45.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.084972 mon.a (mon.0) 557 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:40:45.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.0853364 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:40:45.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: audit 1689212445.0856478 mon.a (mon.0) 559 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:40:45.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:45 smithi137 bash[27262]: cluster 1689212445.1336894 mgr.a (mgr.14152) 321 : cluster 0 pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:45.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.0739841 mon.a (mon.0) 552 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]: dispatch 2023-07-13T01:40:45.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.0837338 mon.a (mon.0) 553 : audit 1 from='client.? 172.21.15.84:0/1344068467' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "297ee438-4a67-45d9-9176-3c084600079c"}]': finished 2023-07-13T01:40:45.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: cluster 1689212445.0838025 mon.a (mon.0) 554 : cluster 0 osdmap e9: 5 total, 0 up, 5 in 2023-07-13T01:40:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.0839627 mon.a (mon.0) 555 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:40:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.0846639 mon.a (mon.0) 556 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:40:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.084972 mon.a (mon.0) 557 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:40:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.0853364 mon.a (mon.0) 558 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:40:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: audit 1689212445.0856478 mon.a (mon.0) 559 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:40:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:45 smithi103 bash[27315]: cluster 1689212445.1336894 mgr.a (mgr.14152) 321 : cluster 0 pgmap v233: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:46.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:46 smithi084 bash[27323]: audit 1689212446.033718 mon.e (mon.1) 11 : audit 0 from='client.? 172.21.15.84:0/2291420341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:40:46.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:46 smithi154 bash[27744]: audit 1689212446.033718 mon.e (mon.1) 11 : audit 0 from='client.? 172.21.15.84:0/2291420341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:40:46.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:46 smithi137 bash[27262]: audit 1689212446.033718 mon.e (mon.1) 11 : audit 0 from='client.? 172.21.15.84:0/2291420341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:40:46.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:46 smithi103 bash[27315]: audit 1689212446.033718 mon.e (mon.1) 11 : audit 0 from='client.? 172.21.15.84:0/2291420341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:40:46.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:46 smithi022 bash[26979]: audit 1689212446.033718 mon.e (mon.1) 11 : audit 0 from='client.? 172.21.15.84:0/2291420341' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:40:47.411 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:46 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:40:47.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:46 smithi022 systemd[1]: Stopped Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:47.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:46 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Start request repeated too quickly. 2023-07-13T01:40:47.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:46 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service: Failed with result 'exit-code'. 2023-07-13T01:40:47.412 INFO:journalctl@ceph.osd.2.smithi022.stdout:Jul 13 01:40:46 smithi022 systemd[1]: Failed to start Ceph osd.2 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:47.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:47 smithi084 bash[27323]: cluster 1689212447.1341538 mgr.a (mgr.14152) 322 : cluster 0 pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:47.648 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:47 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:40:47.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:47 smithi154 bash[27744]: cluster 1689212447.1341538 mgr.a (mgr.14152) 322 : cluster 0 pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:47.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:47 smithi137 bash[27262]: cluster 1689212447.1341538 mgr.a (mgr.14152) 322 : cluster 0 pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:47.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:47 smithi103 bash[27315]: cluster 1689212447.1341538 mgr.a (mgr.14152) 322 : cluster 0 pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:47.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:47 smithi022 bash[26979]: cluster 1689212447.1341538 mgr.a (mgr.14152) 322 : cluster 0 pgmap v234: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:48.661 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:48 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:40:48.662 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:48 smithi022 systemd[1]: Stopped Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:48.662 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:48 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Start request repeated too quickly. 2023-07-13T01:40:48.662 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:48 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service: Failed with result 'exit-code'. 2023-07-13T01:40:48.662 INFO:journalctl@ceph.osd.1.smithi022.stdout:Jul 13 01:40:48 smithi022 systemd[1]: Failed to start Ceph osd.1 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:49.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:49 smithi154 bash[27744]: cluster 1689212449.1346102 mgr.a (mgr.14152) 323 : cluster 0 pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:49.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:49 smithi137 bash[27262]: cluster 1689212449.1346102 mgr.a (mgr.14152) 323 : cluster 0 pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:49.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:49 smithi103 bash[27315]: cluster 1689212449.1346102 mgr.a (mgr.14152) 323 : cluster 0 pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:49.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:49 smithi084 bash[27323]: cluster 1689212449.1346102 mgr.a (mgr.14152) 323 : cluster 0 pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:49.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:49 smithi022 bash[26979]: cluster 1689212449.1346102 mgr.a (mgr.14152) 323 : cluster 0 pgmap v235: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:51.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:51 smithi154 bash[27744]: cluster 1689212451.1351101 mgr.a (mgr.14152) 324 : cluster 0 pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:51.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:51 smithi137 bash[27262]: cluster 1689212451.1351101 mgr.a (mgr.14152) 324 : cluster 0 pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:51.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:51 smithi103 bash[27315]: cluster 1689212451.1351101 mgr.a (mgr.14152) 324 : cluster 0 pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:51.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:51 smithi084 bash[27323]: cluster 1689212451.1351101 mgr.a (mgr.14152) 324 : cluster 0 pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:51.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:51 smithi022 bash[26979]: cluster 1689212451.1351101 mgr.a (mgr.14152) 324 : cluster 0 pgmap v236: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:53.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:53 smithi154 bash[27744]: cluster 1689212453.1355348 mgr.a (mgr.14152) 325 : cluster 0 pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:53.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:53 smithi137 bash[27262]: cluster 1689212453.1355348 mgr.a (mgr.14152) 325 : cluster 0 pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:53.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:53 smithi103 bash[27315]: cluster 1689212453.1355348 mgr.a (mgr.14152) 325 : cluster 0 pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:53.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:53 smithi084 bash[27323]: cluster 1689212453.1355348 mgr.a (mgr.14152) 325 : cluster 0 pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:53.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:53 smithi022 bash[26979]: cluster 1689212453.1355348 mgr.a (mgr.14152) 325 : cluster 0 pgmap v237: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:55.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:55 smithi084 bash[27323]: cluster 1689212455.1359925 mgr.a (mgr.14152) 326 : cluster 0 pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:55.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:55 smithi154 bash[27744]: cluster 1689212455.1359925 mgr.a (mgr.14152) 326 : cluster 0 pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:55.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:55 smithi137 bash[27262]: cluster 1689212455.1359925 mgr.a (mgr.14152) 326 : cluster 0 pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:55.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:55 smithi103 bash[27315]: cluster 1689212455.1359925 mgr.a (mgr.14152) 326 : cluster 0 pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:55.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:55 smithi022 bash[26979]: cluster 1689212455.1359925 mgr.a (mgr.14152) 326 : cluster 0 pgmap v238: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:55.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:55 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 13. 2023-07-13T01:40:55.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:55 smithi022 systemd[1]: Stopped Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:55.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:55 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Start request repeated too quickly. 2023-07-13T01:40:55.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:55 smithi022 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service: Failed with result 'exit-code'. 2023-07-13T01:40:55.912 INFO:journalctl@ceph.osd.0.smithi022.stdout:Jul 13 01:40:55 smithi022 systemd[1]: Failed to start Ceph osd.0 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:57.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:57 smithi154 bash[27744]: cluster 1689212457.136432 mgr.a (mgr.14152) 327 : cluster 0 pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:57.535 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:57 smithi084 bash[27323]: cluster 1689212457.136432 mgr.a (mgr.14152) 327 : cluster 0 pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:57.536 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:57 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:40:57.536 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:57 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:57.536 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:57 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:40:57.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:57 smithi137 bash[27262]: cluster 1689212457.136432 mgr.a (mgr.14152) 327 : cluster 0 pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:57.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:57 smithi103 bash[27315]: cluster 1689212457.136432 mgr.a (mgr.14152) 327 : cluster 0 pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:57.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:57 smithi022 bash[26979]: cluster 1689212457.136432 mgr.a (mgr.14152) 327 : cluster 0 pgmap v239: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:58.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:58 smithi154 bash[27744]: audit 1689212458.2141433 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-13T01:40:58.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:58 smithi154 bash[27744]: audit 1689212458.2156222 mon.a (mon.0) 561 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:58.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:58 smithi137 bash[27262]: audit 1689212458.2141433 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-13T01:40:58.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:58 smithi137 bash[27262]: audit 1689212458.2156222 mon.a (mon.0) 561 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:58.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:58 smithi084 bash[27323]: audit 1689212458.2141433 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-13T01:40:58.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:58 smithi084 bash[27323]: audit 1689212458.2156222 mon.a (mon.0) 561 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:58.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:58 smithi103 bash[27315]: audit 1689212458.2141433 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-13T01:40:58.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:58 smithi103 bash[27315]: audit 1689212458.2156222 mon.a (mon.0) 561 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:58.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:58 smithi022 bash[26979]: audit 1689212458.2141433 mon.a (mon.0) 560 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-13T01:40:58.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:58 smithi022 bash[26979]: audit 1689212458.2156222 mon.a (mon.0) 561 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:40:59.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:59 smithi154 bash[27744]: cephadm 1689212458.217061 mgr.a (mgr.14152) 328 : cephadm 1 Deploying daemon osd.4 on smithi084 2023-07-13T01:40:59.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:40:59 smithi154 bash[27744]: cluster 1689212459.136881 mgr.a (mgr.14152) 329 : cluster 0 pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:59.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:59 smithi137 bash[27262]: cephadm 1689212458.217061 mgr.a (mgr.14152) 328 : cephadm 1 Deploying daemon osd.4 on smithi084 2023-07-13T01:40:59.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:40:59 smithi137 bash[27262]: cluster 1689212459.136881 mgr.a (mgr.14152) 329 : cluster 0 pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:59.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:59 smithi103 bash[27315]: cephadm 1689212458.217061 mgr.a (mgr.14152) 328 : cephadm 1 Deploying daemon osd.4 on smithi084 2023-07-13T01:40:59.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:40:59 smithi103 bash[27315]: cluster 1689212459.136881 mgr.a (mgr.14152) 329 : cluster 0 pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:59.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:59 smithi022 bash[26979]: cephadm 1689212458.217061 mgr.a (mgr.14152) 328 : cephadm 1 Deploying daemon osd.4 on smithi084 2023-07-13T01:40:59.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:40:59 smithi022 bash[26979]: cluster 1689212459.136881 mgr.a (mgr.14152) 329 : cluster 0 pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:59.671 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:59 smithi084 bash[27323]: cephadm 1689212458.217061 mgr.a (mgr.14152) 328 : cephadm 1 Deploying daemon osd.4 on smithi084 2023-07-13T01:40:59.672 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:40:59 smithi084 bash[27323]: cluster 1689212459.136881 mgr.a (mgr.14152) 329 : cluster 0 pgmap v240: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:40:59.672 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:59 smithi084 bash[34838]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:59.672 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:59 smithi084 bash[34838]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:40:59.672 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:59 smithi084 bash[34838]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:40:59.673 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:40:59 smithi084 bash[34838]: --> Failed to activate any OSD(s) 2023-07-13T01:41:01.502 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:01 smithi084 bash[27323]: cluster 1689212461.1373472 mgr.a (mgr.14152) 330 : cluster 0 pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:01.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:01 smithi154 bash[27744]: cluster 1689212461.1373472 mgr.a (mgr.14152) 330 : cluster 0 pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:01.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:01 smithi137 bash[27262]: cluster 1689212461.1373472 mgr.a (mgr.14152) 330 : cluster 0 pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:01.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:01 smithi103 bash[27315]: cluster 1689212461.1373472 mgr.a (mgr.14152) 330 : cluster 0 pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:01.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:01 smithi022 bash[26979]: cluster 1689212461.1373472 mgr.a (mgr.14152) 330 : cluster 0 pgmap v241: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:01.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:01 smithi084 bash[35012]: debug 2023-07-13T01:41:01.635+0000 7f4da7dd3700 1 -- 172.21.15.84:0/3061150775 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7b1ffcd00 con 0x55d7b2052c00 2023-07-13T01:41:01.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:01 smithi084 bash[35012]: debug 2023-07-13T01:41:01.635+0000 7f4db0f58640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:41:03.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:02 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:41:03.377 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:03 smithi084 bash[27323]: cluster 1689212463.1377916 mgr.a (mgr.14152) 331 : cluster 0 pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:03.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:03 smithi154 bash[27744]: cluster 1689212463.1377916 mgr.a (mgr.14152) 331 : cluster 0 pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:03.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:03 smithi137 bash[27262]: cluster 1689212463.1377916 mgr.a (mgr.14152) 331 : cluster 0 pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:03.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:03 smithi103 bash[27315]: cluster 1689212463.1377916 mgr.a (mgr.14152) 331 : cluster 0 pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:03.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:03 smithi022 bash[26979]: cluster 1689212463.1377916 mgr.a (mgr.14152) 331 : cluster 0 pgmap v242: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:06.385 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:05 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:41:06.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:06 smithi084 bash[27323]: audit 1689212465.1277814 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:06 smithi084 bash[27323]: audit 1689212465.1348233 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:06 smithi084 bash[27323]: audit 1689212465.1367269 mon.a (mon.0) 564 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:06.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:06 smithi084 bash[27323]: cluster 1689212465.1382186 mgr.a (mgr.14152) 332 : cluster 0 pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:06.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:06 smithi022 bash[26979]: audit 1689212465.1277814 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:06 smithi022 bash[26979]: audit 1689212465.1348233 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:06 smithi022 bash[26979]: audit 1689212465.1367269 mon.a (mon.0) 564 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:06.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:06 smithi022 bash[26979]: cluster 1689212465.1382186 mgr.a (mgr.14152) 332 : cluster 0 pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:06.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:06 smithi154 bash[27744]: audit 1689212465.1277814 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:06 smithi154 bash[27744]: audit 1689212465.1348233 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:06 smithi154 bash[27744]: audit 1689212465.1367269 mon.a (mon.0) 564 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:06.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:06 smithi154 bash[27744]: cluster 1689212465.1382186 mgr.a (mgr.14152) 332 : cluster 0 pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:06.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:06 smithi137 bash[27262]: audit 1689212465.1277814 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:06 smithi137 bash[27262]: audit 1689212465.1348233 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:06 smithi137 bash[27262]: audit 1689212465.1367269 mon.a (mon.0) 564 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:06.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:06 smithi137 bash[27262]: cluster 1689212465.1382186 mgr.a (mgr.14152) 332 : cluster 0 pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:06.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:06 smithi103 bash[27315]: audit 1689212465.1277814 mon.a (mon.0) 562 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:06 smithi103 bash[27315]: audit 1689212465.1348233 mon.a (mon.0) 563 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:06.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:06 smithi103 bash[27315]: audit 1689212465.1367269 mon.a (mon.0) 564 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:06.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:06 smithi103 bash[27315]: cluster 1689212465.1382186 mgr.a (mgr.14152) 332 : cluster 0 pgmap v243: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:07.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:07 smithi154 bash[27744]: cluster 1689212467.1386867 mgr.a (mgr.14152) 333 : cluster 0 pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:07.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:07 smithi137 bash[27262]: cluster 1689212467.1386867 mgr.a (mgr.14152) 333 : cluster 0 pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:07.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:07 smithi103 bash[27315]: cluster 1689212467.1386867 mgr.a (mgr.14152) 333 : cluster 0 pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:07.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:07 smithi084 bash[27323]: cluster 1689212467.1386867 mgr.a (mgr.14152) 333 : cluster 0 pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:07.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:07 smithi022 bash[26979]: cluster 1689212467.1386867 mgr.a (mgr.14152) 333 : cluster 0 pgmap v244: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:09.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:09 smithi154 bash[27744]: cluster 1689212469.1392193 mgr.a (mgr.14152) 334 : cluster 0 pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:09.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:09 smithi137 bash[27262]: cluster 1689212469.1392193 mgr.a (mgr.14152) 334 : cluster 0 pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:09.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:09 smithi103 bash[27315]: cluster 1689212469.1392193 mgr.a (mgr.14152) 334 : cluster 0 pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:09.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:09 smithi084 bash[27323]: cluster 1689212469.1392193 mgr.a (mgr.14152) 334 : cluster 0 pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:09.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:09 smithi022 bash[26979]: cluster 1689212469.1392193 mgr.a (mgr.14152) 334 : cluster 0 pgmap v245: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: audit 1689212470.4924536 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: audit 1689212470.499791 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: audit 1689212470.5012422 mon.a (mon.0) 567 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:11.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: audit 1689212470.5027287 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:11.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: cluster 1689212470.5055683 mgr.a (mgr.14152) 335 : cluster 0 pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: cluster 1689212470.50577 mgr.a (mgr.14152) 336 : cluster 0 pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:11 smithi154 bash[27744]: audit 1689212470.5124176 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: audit 1689212470.4924536 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: audit 1689212470.499791 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: audit 1689212470.5012422 mon.a (mon.0) 567 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:11.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: audit 1689212470.5027287 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:11.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: cluster 1689212470.5055683 mgr.a (mgr.14152) 335 : cluster 0 pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: cluster 1689212470.50577 mgr.a (mgr.14152) 336 : cluster 0 pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:11 smithi137 bash[27262]: audit 1689212470.5124176 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: audit 1689212470.4924536 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: audit 1689212470.499791 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: audit 1689212470.5012422 mon.a (mon.0) 567 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:11.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: audit 1689212470.5027287 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:11.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: cluster 1689212470.5055683 mgr.a (mgr.14152) 335 : cluster 0 pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: cluster 1689212470.50577 mgr.a (mgr.14152) 336 : cluster 0 pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:11 smithi103 bash[27315]: audit 1689212470.5124176 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: audit 1689212470.4924536 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: audit 1689212470.499791 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: audit 1689212470.5012422 mon.a (mon.0) 567 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:11.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: audit 1689212470.5027287 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:11.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: cluster 1689212470.5055683 mgr.a (mgr.14152) 335 : cluster 0 pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: cluster 1689212470.50577 mgr.a (mgr.14152) 336 : cluster 0 pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:11 smithi084 bash[27323]: audit 1689212470.5124176 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: audit 1689212470.4924536 mon.a (mon.0) 565 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: audit 1689212470.499791 mon.a (mon.0) 566 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:11.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: audit 1689212470.5012422 mon.a (mon.0) 567 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:11.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: audit 1689212470.5027287 mon.a (mon.0) 568 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:11.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: cluster 1689212470.5055683 mgr.a (mgr.14152) 335 : cluster 0 pgmap v246: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: cluster 1689212470.50577 mgr.a (mgr.14152) 336 : cluster 0 pgmap v247: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:11.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:11 smithi022 bash[26979]: audit 1689212470.5124176 mon.a (mon.0) 569 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:12.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:12 smithi154 bash[27744]: cluster 1689212471.496751 mon.a (mon.0) 570 : cluster 3 Health check update: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:41:12.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:12 smithi137 bash[27262]: cluster 1689212471.496751 mon.a (mon.0) 570 : cluster 3 Health check update: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:41:12.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:12 smithi103 bash[27315]: cluster 1689212471.496751 mon.a (mon.0) 570 : cluster 3 Health check update: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:41:12.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:12 smithi084 bash[27323]: cluster 1689212471.496751 mon.a (mon.0) 570 : cluster 3 Health check update: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:41:12.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:12 smithi022 bash[26979]: cluster 1689212471.496751 mon.a (mon.0) 570 : cluster 3 Health check update: 5 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:41:13.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:13 smithi154 bash[27744]: cluster 1689212472.5062041 mgr.a (mgr.14152) 337 : cluster 0 pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:13.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:13 smithi137 bash[27262]: cluster 1689212472.5062041 mgr.a (mgr.14152) 337 : cluster 0 pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:13.828 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:13 smithi084 bash[27323]: cluster 1689212472.5062041 mgr.a (mgr.14152) 337 : cluster 0 pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:13.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:13 smithi103 bash[27315]: cluster 1689212472.5062041 mgr.a (mgr.14152) 337 : cluster 0 pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:13.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:13 smithi022 bash[26979]: cluster 1689212472.5062041 mgr.a (mgr.14152) 337 : cluster 0 pgmap v248: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:14.312 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 4 on host 'smithi084' 2023-07-13T01:41:14.965 DEBUG:teuthology.orchestra.run.smithi084:osd.4> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service 2023-07-13T01:41:14.969 INFO:tasks.cephadm:Deploying osd.5 on smithi084 with /dev/vg_nvme/lv_2... 2023-07-13T01:41:14.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-13T01:41:15.155 INFO:journalctl@ceph.osd.4.smithi084.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:41:15.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:15 smithi137 bash[27262]: audit 1689212474.299403 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:15 smithi137 bash[27262]: audit 1689212474.3080063 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:15 smithi137 bash[27262]: audit 1689212474.3085258 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:15.559 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:15 smithi137 bash[27262]: cluster 1689212474.506671 mgr.a (mgr.14152) 338 : cluster 0 pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:15.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:15 smithi103 bash[27315]: audit 1689212474.299403 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:15 smithi103 bash[27315]: audit 1689212474.3080063 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:15 smithi103 bash[27315]: audit 1689212474.3085258 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:15.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:15 smithi103 bash[27315]: cluster 1689212474.506671 mgr.a (mgr.14152) 338 : cluster 0 pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:15.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:15 smithi084 bash[27323]: audit 1689212474.299403 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:15 smithi084 bash[27323]: audit 1689212474.3080063 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:15 smithi084 bash[27323]: audit 1689212474.3085258 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:15.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:15 smithi084 bash[27323]: cluster 1689212474.506671 mgr.a (mgr.14152) 338 : cluster 0 pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:15.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:15 smithi022 bash[26979]: audit 1689212474.299403 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:15 smithi022 bash[26979]: audit 1689212474.3080063 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:15 smithi022 bash[26979]: audit 1689212474.3085258 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:15.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:15 smithi022 bash[26979]: cluster 1689212474.506671 mgr.a (mgr.14152) 338 : cluster 0 pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:15.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:15 smithi154 bash[27744]: audit 1689212474.299403 mon.a (mon.0) 571 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:15 smithi154 bash[27744]: audit 1689212474.3080063 mon.a (mon.0) 572 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:15.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:15 smithi154 bash[27744]: audit 1689212474.3085258 mon.a (mon.0) 573 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:41:15.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:15 smithi154 bash[27744]: cluster 1689212474.506671 mgr.a (mgr.14152) 338 : cluster 0 pgmap v249: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:16.647 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:16 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:41:16.648 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:16 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:16.648 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:16 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:17.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:17 smithi103 bash[27315]: cluster 1689212476.5071185 mgr.a (mgr.14152) 339 : cluster 0 pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:17.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:17 smithi084 bash[27323]: cluster 1689212476.5071185 mgr.a (mgr.14152) 339 : cluster 0 pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:17.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:17 smithi084 bash[36337]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:17.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:17 smithi084 bash[36337]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:17.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:17 smithi084 bash[36337]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:41:17.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:17 smithi084 bash[36337]: --> Failed to activate any OSD(s) 2023-07-13T01:41:17.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:17 smithi022 bash[26979]: cluster 1689212476.5071185 mgr.a (mgr.14152) 339 : cluster 0 pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:18.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:17 smithi154 bash[27744]: cluster 1689212476.5071185 mgr.a (mgr.14152) 339 : cluster 0 pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:18.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:17 smithi137 bash[27262]: cluster 1689212476.5071185 mgr.a (mgr.14152) 339 : cluster 0 pgmap v250: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:19.377 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:19 smithi084 bash[36478]: debug 2023-07-13T01:41:19.171+0000 7f7e055ee700 1 -- 172.21.15.84:0/374999944 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555698e18d00 con 0x555698e6f000 2023-07-13T01:41:19.377 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:19 smithi084 bash[36478]: debug 2023-07-13T01:41:19.175+0000 7f7e0e773640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:41:19.591 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.b/config 2023-07-13T01:41:19.696 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:19 smithi084 bash[27323]: cluster 1689212478.5075874 mgr.a (mgr.14152) 340 : cluster 0 pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:19.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:19 smithi103 bash[27315]: cluster 1689212478.5075874 mgr.a (mgr.14152) 340 : cluster 0 pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:19.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:19 smithi022 bash[26979]: cluster 1689212478.5075874 mgr.a (mgr.14152) 340 : cluster 0 pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:20.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:19 smithi154 bash[27744]: cluster 1689212478.5075874 mgr.a (mgr.14152) 340 : cluster 0 pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:20.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:19 smithi137 bash[27262]: cluster 1689212478.5075874 mgr.a (mgr.14152) 340 : cluster 0 pgmap v251: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:20.647 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:20 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:41:21.767 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:21 smithi084 bash[27323]: cluster 1689212480.5080378 mgr.a (mgr.14152) 341 : cluster 0 pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:21.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:21 smithi103 bash[27315]: cluster 1689212480.5080378 mgr.a (mgr.14152) 341 : cluster 0 pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:21.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:21 smithi022 bash[26979]: cluster 1689212480.5080378 mgr.a (mgr.14152) 341 : cluster 0 pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:22.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:21 smithi154 bash[27744]: cluster 1689212480.5080378 mgr.a (mgr.14152) 341 : cluster 0 pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:22.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:21 smithi137 bash[27262]: cluster 1689212480.5080378 mgr.a (mgr.14152) 341 : cluster 0 pgmap v252: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:22.147 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:21 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:41:22.147 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:21 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:22.148 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:21 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:23.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:23 smithi103 bash[27315]: cluster 1689212482.5084815 mgr.a (mgr.14152) 342 : cluster 0 pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:23.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:23 smithi084 bash[27323]: cluster 1689212482.5084815 mgr.a (mgr.14152) 342 : cluster 0 pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:23.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:23 smithi022 bash[26979]: cluster 1689212482.5084815 mgr.a (mgr.14152) 342 : cluster 0 pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:24.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:23 smithi154 bash[27744]: cluster 1689212482.5084815 mgr.a (mgr.14152) 342 : cluster 0 pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:24.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:23 smithi137 bash[27262]: cluster 1689212482.5084815 mgr.a (mgr.14152) 342 : cluster 0 pgmap v253: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:25.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:24 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:41:25.566 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:25 smithi084 bash[36782]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:25.567 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:25 smithi084 bash[36782]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:25.567 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:25 smithi084 bash[36782]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:41:25.567 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:25 smithi084 bash[36782]: --> Failed to activate any OSD(s) 2023-07-13T01:41:25.567 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:25 smithi084 bash[27323]: cluster 1689212484.5089579 mgr.a (mgr.14152) 343 : cluster 0 pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:25.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:25 smithi154 bash[27744]: cluster 1689212484.5089579 mgr.a (mgr.14152) 343 : cluster 0 pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:25.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:25 smithi137 bash[27262]: cluster 1689212484.5089579 mgr.a (mgr.14152) 343 : cluster 0 pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:25.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:25 smithi103 bash[27315]: cluster 1689212484.5089579 mgr.a (mgr.14152) 343 : cluster 0 pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:25.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:25 smithi022 bash[26979]: cluster 1689212484.5089579 mgr.a (mgr.14152) 343 : cluster 0 pgmap v254: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:27.601 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-13T01:41:27.601 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-13T01:41:27.602 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2023-07-13T01:41:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2023-07-13T01:41:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0166099 s, 631 MB/s 2023-07-13T01:41:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2023-07-13T01:41:27.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:27 smithi103 bash[27315]: cluster 1689212486.509431 mgr.a (mgr.14152) 344 : cluster 0 pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:27.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:27 smithi084 bash[27323]: cluster 1689212486.509431 mgr.a (mgr.14152) 344 : cluster 0 pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:27.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:27 smithi022 bash[26979]: cluster 1689212486.509431 mgr.a (mgr.14152) 344 : cluster 0 pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:28.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:27 smithi154 bash[27744]: cluster 1689212486.509431 mgr.a (mgr.14152) 344 : cluster 0 pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:28.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:27 smithi137 bash[27262]: cluster 1689212486.509431 mgr.a (mgr.14152) 344 : cluster 0 pgmap v255: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:28.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:28 smithi084 bash[37027]: debug 2023-07-13T01:41:28.122+0000 7f30ea403700 1 -- 172.21.15.84:0/827111545 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557039a6ad00 con 0x557039ac0800 2023-07-13T01:41:28.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:28 smithi084 bash[37027]: debug 2023-07-13T01:41:28.126+0000 7f30f3588640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:41:28.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2023-07-13T01:41:29.648 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:29 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:41:29.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: cephadm 1689212488.439707 mgr.a (mgr.14152) 345 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:41:29.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.4506516 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.4583287 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.4599707 mon.a (mon.0) 576 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.461367 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: cephadm 1689212488.4623888 mgr.a (mgr.14152) 346 : cephadm 1 Adjusting osd_memory_target on smithi084 to 8632M 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.4685795 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.4700537 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.471308 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: cluster 1689212488.4740915 mgr.a (mgr.14152) 347 : cluster 0 pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: cluster 1689212488.474324 mgr.a (mgr.14152) 348 : cluster 0 pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:29 smithi084 bash[27323]: audit 1689212488.4816303 mon.a (mon.0) 581 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: cephadm 1689212488.439707 mgr.a (mgr.14152) 345 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:41:29.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.4506516 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.4583287 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.4599707 mon.a (mon.0) 576 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.461367 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: cephadm 1689212488.4623888 mgr.a (mgr.14152) 346 : cephadm 1 Adjusting osd_memory_target on smithi084 to 8632M 2023-07-13T01:41:29.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.4685795 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.4700537 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:29.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.471308 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:29.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: cluster 1689212488.4740915 mgr.a (mgr.14152) 347 : cluster 0 pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: cluster 1689212488.474324 mgr.a (mgr.14152) 348 : cluster 0 pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:29 smithi154 bash[27744]: audit 1689212488.4816303 mon.a (mon.0) 581 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: cephadm 1689212488.439707 mgr.a (mgr.14152) 345 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:41:29.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.4506516 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.4583287 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.4599707 mon.a (mon.0) 576 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.461367 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: cephadm 1689212488.4623888 mgr.a (mgr.14152) 346 : cephadm 1 Adjusting osd_memory_target on smithi084 to 8632M 2023-07-13T01:41:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.4685795 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.4700537 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.471308 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: cluster 1689212488.4740915 mgr.a (mgr.14152) 347 : cluster 0 pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: cluster 1689212488.474324 mgr.a (mgr.14152) 348 : cluster 0 pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:29 smithi137 bash[27262]: audit 1689212488.4816303 mon.a (mon.0) 581 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: cephadm 1689212488.439707 mgr.a (mgr.14152) 345 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:41:29.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.4506516 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.4583287 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.4599707 mon.a (mon.0) 576 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.461367 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: cephadm 1689212488.4623888 mgr.a (mgr.14152) 346 : cephadm 1 Adjusting osd_memory_target on smithi084 to 8632M 2023-07-13T01:41:29.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.4685795 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.4700537 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.471308 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: cluster 1689212488.4740915 mgr.a (mgr.14152) 347 : cluster 0 pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: cluster 1689212488.474324 mgr.a (mgr.14152) 348 : cluster 0 pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:29 smithi103 bash[27315]: audit 1689212488.4816303 mon.a (mon.0) 581 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: cephadm 1689212488.439707 mgr.a (mgr.14152) 345 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:41:29.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.4506516 mon.a (mon.0) 574 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.4583287 mon.a (mon.0) 575 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.4599707 mon.a (mon.0) 576 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.461367 mon.a (mon.0) 577 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:41:29.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: cephadm 1689212488.4623888 mgr.a (mgr.14152) 346 : cephadm 1 Adjusting osd_memory_target on smithi084 to 8632M 2023-07-13T01:41:29.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.4685795 mon.a (mon.0) 578 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:29.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.4700537 mon.a (mon.0) 579 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:29.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.471308 mon.a (mon.0) 580 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:41:29.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: cluster 1689212488.4740915 mgr.a (mgr.14152) 347 : cluster 0 pgmap v256: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: cluster 1689212488.474324 mgr.a (mgr.14152) 348 : cluster 0 pgmap v257: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:29.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:29 smithi022 bash[26979]: audit 1689212488.4816303 mon.a (mon.0) 581 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:41:31.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:31 smithi084 bash[27323]: cluster 1689212490.4748027 mgr.a (mgr.14152) 349 : cluster 0 pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:31.647 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:31 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:41:31.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:31 smithi154 bash[27744]: cluster 1689212490.4748027 mgr.a (mgr.14152) 349 : cluster 0 pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:31.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:31 smithi137 bash[27262]: cluster 1689212490.4748027 mgr.a (mgr.14152) 349 : cluster 0 pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:31.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:31 smithi103 bash[27315]: cluster 1689212490.4748027 mgr.a (mgr.14152) 349 : cluster 0 pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:31.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:31 smithi022 bash[26979]: cluster 1689212490.4748027 mgr.a (mgr.14152) 349 : cluster 0 pgmap v258: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:33.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:33 smithi154 bash[27744]: cluster 1689212492.475201 mgr.a (mgr.14152) 350 : cluster 0 pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:33.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:33 smithi137 bash[27262]: cluster 1689212492.475201 mgr.a (mgr.14152) 350 : cluster 0 pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:33.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:33 smithi103 bash[27315]: cluster 1689212492.475201 mgr.a (mgr.14152) 350 : cluster 0 pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:33.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:33 smithi084 bash[27323]: cluster 1689212492.475201 mgr.a (mgr.14152) 350 : cluster 0 pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:33.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:33 smithi022 bash[26979]: cluster 1689212492.475201 mgr.a (mgr.14152) 350 : cluster 0 pgmap v259: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.b/config 2023-07-13T01:41:35.165 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:34 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:41:35.165 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:34 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:35.166 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:34 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:35.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:35 smithi154 bash[27744]: cluster 1689212494.4756536 mgr.a (mgr.14152) 351 : cluster 0 pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:35.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:35 smithi137 bash[27262]: cluster 1689212494.4756536 mgr.a (mgr.14152) 351 : cluster 0 pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:35.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:35 smithi103 bash[27315]: cluster 1689212494.4756536 mgr.a (mgr.14152) 351 : cluster 0 pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:35.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:35 smithi084 bash[27323]: cluster 1689212494.4756536 mgr.a (mgr.14152) 351 : cluster 0 pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:35.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:35 smithi022 bash[26979]: cluster 1689212494.4756536 mgr.a (mgr.14152) 351 : cluster 0 pgmap v260: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:37.080 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:36 smithi084 bash[38178]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:37.081 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:36 smithi084 bash[38178]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:37.081 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:36 smithi084 bash[38178]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:41:37.081 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:36 smithi084 bash[38178]: --> Failed to activate any OSD(s) 2023-07-13T01:41:37.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:37 smithi154 bash[27744]: cluster 1689212496.4760494 mgr.a (mgr.14152) 352 : cluster 0 pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:37.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:37 smithi137 bash[27262]: cluster 1689212496.4760494 mgr.a (mgr.14152) 352 : cluster 0 pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:37.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:37 smithi103 bash[27315]: cluster 1689212496.4760494 mgr.a (mgr.14152) 352 : cluster 0 pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:37.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:37 smithi084 bash[27323]: cluster 1689212496.4760494 mgr.a (mgr.14152) 352 : cluster 0 pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:37.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:37 smithi022 bash[26979]: cluster 1689212496.4760494 mgr.a (mgr.14152) 352 : cluster 0 pgmap v261: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:38.768 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:38 smithi084 bash[38366]: debug 2023-07-13T01:41:38.706+0000 7fdbfff7d700 1 -- 172.21.15.84:0/3870428969 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a3e92ced00 con 0x55a3e9324800 2023-07-13T01:41:38.768 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:38 smithi084 bash[38366]: debug 2023-07-13T01:41:38.706+0000 7fdc09102640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:41:38.769 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:38 smithi084 bash[27323]: audit 1689212497.9566228 mgr.a (mgr.14152) 353 : audit 0 from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:41:38.769 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:38 smithi084 bash[27323]: audit 1689212497.963879 mon.a (mon.0) 582 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:41:38.769 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:38 smithi084 bash[27323]: audit 1689212497.9695265 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:41:38.769 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:38 smithi084 bash[27323]: audit 1689212497.971142 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:38.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:38 smithi137 bash[27262]: audit 1689212497.9566228 mgr.a (mgr.14152) 353 : audit 0 from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:41:38.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:38 smithi137 bash[27262]: audit 1689212497.963879 mon.a (mon.0) 582 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:41:38.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:38 smithi137 bash[27262]: audit 1689212497.9695265 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:41:38.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:38 smithi137 bash[27262]: audit 1689212497.971142 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:38.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:38 smithi103 bash[27315]: audit 1689212497.9566228 mgr.a (mgr.14152) 353 : audit 0 from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:41:38.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:38 smithi103 bash[27315]: audit 1689212497.963879 mon.a (mon.0) 582 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:41:38.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:38 smithi103 bash[27315]: audit 1689212497.9695265 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:41:38.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:38 smithi103 bash[27315]: audit 1689212497.971142 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:38.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:38 smithi022 bash[26979]: audit 1689212497.9566228 mgr.a (mgr.14152) 353 : audit 0 from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:41:38.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:38 smithi022 bash[26979]: audit 1689212497.963879 mon.a (mon.0) 582 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:41:38.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:38 smithi022 bash[26979]: audit 1689212497.9695265 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:41:38.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:38 smithi022 bash[26979]: audit 1689212497.971142 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:39.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:38 smithi154 bash[27744]: audit 1689212497.9566228 mgr.a (mgr.14152) 353 : audit 0 from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:41:39.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:38 smithi154 bash[27744]: audit 1689212497.963879 mon.a (mon.0) 582 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:41:39.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:38 smithi154 bash[27744]: audit 1689212497.9695265 mon.a (mon.0) 583 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:41:39.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:38 smithi154 bash[27744]: audit 1689212497.971142 mon.a (mon.0) 584 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:41:39.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:39 smithi084 bash[27323]: cluster 1689212498.4764502 mgr.a (mgr.14152) 354 : cluster 0 pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:39.648 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:39 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:41:39.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:39 smithi137 bash[27262]: cluster 1689212498.4764502 mgr.a (mgr.14152) 354 : cluster 0 pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:39 smithi103 bash[27315]: cluster 1689212498.4764502 mgr.a (mgr.14152) 354 : cluster 0 pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:39.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:39 smithi022 bash[26979]: cluster 1689212498.4764502 mgr.a (mgr.14152) 354 : cluster 0 pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:40.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:39 smithi154 bash[27744]: cluster 1689212498.4764502 mgr.a (mgr.14152) 354 : cluster 0 pgmap v262: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:41.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:41 smithi137 bash[27262]: cluster 1689212500.476909 mgr.a (mgr.14152) 355 : cluster 0 pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:41.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:41 smithi103 bash[27315]: cluster 1689212500.476909 mgr.a (mgr.14152) 355 : cluster 0 pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:41.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:41 smithi084 bash[27323]: cluster 1689212500.476909 mgr.a (mgr.14152) 355 : cluster 0 pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:41.898 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:41 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:41:41.898 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:41 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:41:41.898 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:41 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:41.898 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:41 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:41.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:41 smithi022 bash[26979]: cluster 1689212500.476909 mgr.a (mgr.14152) 355 : cluster 0 pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:42.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:41 smithi154 bash[27744]: cluster 1689212500.476909 mgr.a (mgr.14152) 355 : cluster 0 pgmap v263: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:43.061 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:42 smithi084 bash[38686]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:43.061 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:42 smithi084 bash[38686]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:43.062 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:42 smithi084 bash[38686]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:41:43.062 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:42 smithi084 bash[38686]: --> Failed to activate any OSD(s) 2023-07-13T01:41:43.784 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:43 smithi084 bash[27323]: cluster 1689212502.4773834 mgr.a (mgr.14152) 356 : cluster 0 pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:43.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:43 smithi137 bash[27262]: cluster 1689212502.4773834 mgr.a (mgr.14152) 356 : cluster 0 pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:43.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:43 smithi103 bash[27315]: cluster 1689212502.4773834 mgr.a (mgr.14152) 356 : cluster 0 pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:43.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:43 smithi022 bash[26979]: cluster 1689212502.4773834 mgr.a (mgr.14152) 356 : cluster 0 pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:44.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:43 smithi154 bash[27744]: cluster 1689212502.4773834 mgr.a (mgr.14152) 356 : cluster 0 pgmap v264: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:45.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:45 smithi084 bash[38802]: debug 2023-07-13T01:41:45.106+0000 7fa267d08700 1 -- 172.21.15.84:0/2603519946 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606f23ded00 con 0x5606f2434800 2023-07-13T01:41:45.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:45 smithi084 bash[38802]: debug 2023-07-13T01:41:45.106+0000 7fa270e8d640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:41:45.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:45 smithi137 bash[27262]: cluster 1689212504.4778385 mgr.a (mgr.14152) 357 : cluster 0 pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:45.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:45 smithi103 bash[27315]: cluster 1689212504.4778385 mgr.a (mgr.14152) 357 : cluster 0 pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:45.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:45 smithi084 bash[27323]: cluster 1689212504.4778385 mgr.a (mgr.14152) 357 : cluster 0 pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:45.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:45 smithi022 bash[26979]: cluster 1689212504.4778385 mgr.a (mgr.14152) 357 : cluster 0 pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:46.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:45 smithi154 bash[27744]: cluster 1689212504.4778385 mgr.a (mgr.14152) 357 : cluster 0 pgmap v265: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:46.647 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:46 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:41:47.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:47 smithi137 bash[27262]: cluster 1689212506.4783425 mgr.a (mgr.14152) 358 : cluster 0 pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:47.828 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:47 smithi084 bash[27323]: cluster 1689212506.4783425 mgr.a (mgr.14152) 358 : cluster 0 pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:47.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:47 smithi103 bash[27315]: cluster 1689212506.4783425 mgr.a (mgr.14152) 358 : cluster 0 pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:47.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:47 smithi022 bash[26979]: cluster 1689212506.4783425 mgr.a (mgr.14152) 358 : cluster 0 pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:48.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:47 smithi154 bash[27744]: cluster 1689212506.4783425 mgr.a (mgr.14152) 358 : cluster 0 pgmap v266: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:49.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:48 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:41:49.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: cluster 1689212508.4788163 mgr.a (mgr.14152) 359 : cluster 0 pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:49.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.5555403 mon.b (mon.4) 15 : audit 1 from='client.? 172.21.15.84:0/286383893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.5564036 mon.a (mon.0) 585 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.564548 mon.a (mon.0) 586 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]': finished 2023-07-13T01:41:49.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: cluster 1689212508.5646508 mon.a (mon.0) 587 : cluster 0 osdmap e10: 6 total, 0 up, 6 in 2023-07-13T01:41:49.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.5649126 mon.a (mon.0) 588 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:41:49.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.5654912 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:41:49.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.565863 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:41:49.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.566286 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:41:49.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.5666816 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:41:49.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212508.567106 mon.a (mon.0) 593 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:41:49.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:49 smithi137 bash[27262]: audit 1689212509.4055037 mon.b (mon.4) 16 : audit 0 from='client.? 172.21.15.84:0/3286966503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:41:49.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: cluster 1689212508.4788163 mgr.a (mgr.14152) 359 : cluster 0 pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:49.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.5555403 mon.b (mon.4) 15 : audit 1 from='client.? 172.21.15.84:0/286383893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.5564036 mon.a (mon.0) 585 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.564548 mon.a (mon.0) 586 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]': finished 2023-07-13T01:41:49.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: cluster 1689212508.5646508 mon.a (mon.0) 587 : cluster 0 osdmap e10: 6 total, 0 up, 6 in 2023-07-13T01:41:49.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.5649126 mon.a (mon.0) 588 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:41:49.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.5654912 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:41:49.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.565863 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:41:49.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.566286 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:41:49.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.5666816 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:41:49.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212508.567106 mon.a (mon.0) 593 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:41:49.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:49 smithi103 bash[27315]: audit 1689212509.4055037 mon.b (mon.4) 16 : audit 0 from='client.? 172.21.15.84:0/3286966503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:41:49.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: cluster 1689212508.4788163 mgr.a (mgr.14152) 359 : cluster 0 pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:49.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.5555403 mon.b (mon.4) 15 : audit 1 from='client.? 172.21.15.84:0/286383893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.5564036 mon.a (mon.0) 585 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.564548 mon.a (mon.0) 586 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]': finished 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: cluster 1689212508.5646508 mon.a (mon.0) 587 : cluster 0 osdmap e10: 6 total, 0 up, 6 in 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.5649126 mon.a (mon.0) 588 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.5654912 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.565863 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.566286 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:41:49.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.5666816 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:41:49.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212508.567106 mon.a (mon.0) 593 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:41:49.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:49 smithi084 bash[27323]: audit 1689212509.4055037 mon.b (mon.4) 16 : audit 0 from='client.? 172.21.15.84:0/3286966503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:41:49.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: cluster 1689212508.4788163 mgr.a (mgr.14152) 359 : cluster 0 pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:49.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.5555403 mon.b (mon.4) 15 : audit 1 from='client.? 172.21.15.84:0/286383893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.5564036 mon.a (mon.0) 585 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:49.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.564548 mon.a (mon.0) 586 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]': finished 2023-07-13T01:41:49.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: cluster 1689212508.5646508 mon.a (mon.0) 587 : cluster 0 osdmap e10: 6 total, 0 up, 6 in 2023-07-13T01:41:49.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.5649126 mon.a (mon.0) 588 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:41:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.5654912 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:41:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.565863 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:41:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.566286 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:41:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.5666816 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:41:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212508.567106 mon.a (mon.0) 593 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:41:49.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:49 smithi022 bash[26979]: audit 1689212509.4055037 mon.b (mon.4) 16 : audit 0 from='client.? 172.21.15.84:0/3286966503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:41:50.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: cluster 1689212508.4788163 mgr.a (mgr.14152) 359 : cluster 0 pgmap v267: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:50.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.5555403 mon.b (mon.4) 15 : audit 1 from='client.? 172.21.15.84:0/286383893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:50.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.5564036 mon.a (mon.0) 585 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]: dispatch 2023-07-13T01:41:50.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.564548 mon.a (mon.0) 586 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a820fb9d-f65b-49fb-9409-e27448f1a910"}]': finished 2023-07-13T01:41:50.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: cluster 1689212508.5646508 mon.a (mon.0) 587 : cluster 0 osdmap e10: 6 total, 0 up, 6 in 2023-07-13T01:41:50.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.5649126 mon.a (mon.0) 588 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:41:50.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.5654912 mon.a (mon.0) 589 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:41:50.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.565863 mon.a (mon.0) 590 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:41:50.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.566286 mon.a (mon.0) 591 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:41:50.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.5666816 mon.a (mon.0) 592 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:41:50.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212508.567106 mon.a (mon.0) 593 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:41:50.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:49 smithi154 bash[27744]: audit 1689212509.4055037 mon.b (mon.4) 16 : audit 0 from='client.? 172.21.15.84:0/3286966503' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:41:51.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:51 smithi137 bash[27262]: cluster 1689212510.4793055 mgr.a (mgr.14152) 360 : cluster 0 pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:51.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:51 smithi103 bash[27315]: cluster 1689212510.4793055 mgr.a (mgr.14152) 360 : cluster 0 pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:51.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:51 smithi084 bash[27323]: cluster 1689212510.4793055 mgr.a (mgr.14152) 360 : cluster 0 pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:51.897 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:51 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:41:51.897 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:51 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:51.897 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:51 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:51.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:51 smithi022 bash[26979]: cluster 1689212510.4793055 mgr.a (mgr.14152) 360 : cluster 0 pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:51 smithi154 bash[27744]: cluster 1689212510.4793055 mgr.a (mgr.14152) 360 : cluster 0 pgmap v269: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:53.670 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:53 smithi084 bash[27323]: cluster 1689212512.479732 mgr.a (mgr.14152) 361 : cluster 0 pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:53.671 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:53 smithi084 bash[40047]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:53.671 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:53 smithi084 bash[40047]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:41:53.671 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:53 smithi084 bash[40047]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:41:53.671 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:53 smithi084 bash[40047]: --> Failed to activate any OSD(s) 2023-07-13T01:41:53.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:53 smithi137 bash[27262]: cluster 1689212512.479732 mgr.a (mgr.14152) 361 : cluster 0 pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:53.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:53 smithi103 bash[27315]: cluster 1689212512.479732 mgr.a (mgr.14152) 361 : cluster 0 pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:53.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:53 smithi022 bash[26979]: cluster 1689212512.479732 mgr.a (mgr.14152) 361 : cluster 0 pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:54.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:53 smithi154 bash[27744]: cluster 1689212512.479732 mgr.a (mgr.14152) 361 : cluster 0 pgmap v270: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:55.526 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:55 smithi084 bash[40358]: debug 2023-07-13T01:41:55.282+0000 7fbf16a54700 1 -- 172.21.15.84:0/2411558785 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a873bb2d00 con 0x55a873c09000 2023-07-13T01:41:55.526 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:55 smithi084 bash[40358]: debug 2023-07-13T01:41:55.286+0000 7fbf1fbd9640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:41:55.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:55 smithi137 bash[27262]: cluster 1689212514.4801638 mgr.a (mgr.14152) 362 : cluster 0 pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:55.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:55 smithi103 bash[27315]: cluster 1689212514.4801638 mgr.a (mgr.14152) 362 : cluster 0 pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:55.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:55 smithi084 bash[27323]: cluster 1689212514.4801638 mgr.a (mgr.14152) 362 : cluster 0 pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:55.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:55 smithi022 bash[26979]: cluster 1689212514.4801638 mgr.a (mgr.14152) 362 : cluster 0 pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:56.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:55 smithi154 bash[27744]: cluster 1689212514.4801638 mgr.a (mgr.14152) 362 : cluster 0 pgmap v271: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:56.396 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:56 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:41:57.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:57 smithi137 bash[27262]: cluster 1689212516.480614 mgr.a (mgr.14152) 363 : cluster 0 pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:57.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:57 smithi103 bash[27315]: cluster 1689212516.480614 mgr.a (mgr.14152) 363 : cluster 0 pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:57.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:57 smithi084 bash[27323]: cluster 1689212516.480614 mgr.a (mgr.14152) 363 : cluster 0 pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:57.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:57 smithi022 bash[26979]: cluster 1689212516.480614 mgr.a (mgr.14152) 363 : cluster 0 pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:58.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:57 smithi154 bash[27744]: cluster 1689212516.480614 mgr.a (mgr.14152) 363 : cluster 0 pgmap v272: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:58.972 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:41:58 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:41:59.359 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:59 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:41:59.360 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:59 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:59.360 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:41:59 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:41:59.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:41:59 smithi084 bash[27323]: cluster 1689212518.481062 mgr.a (mgr.14152) 364 : cluster 0 pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:59.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:41:59 smithi103 bash[27315]: cluster 1689212518.481062 mgr.a (mgr.14152) 364 : cluster 0 pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:41:59.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:41:59 smithi022 bash[26979]: cluster 1689212518.481062 mgr.a (mgr.14152) 364 : cluster 0 pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:00.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:41:59 smithi154 bash[27744]: cluster 1689212518.481062 mgr.a (mgr.14152) 364 : cluster 0 pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:00.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:41:59 smithi137 bash[27262]: cluster 1689212518.481062 mgr.a (mgr.14152) 364 : cluster 0 pgmap v273: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:01.396 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:01 smithi084 bash[40692]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:01.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:01 smithi084 bash[40692]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:01.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:01 smithi084 bash[40692]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:01.397 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:01 smithi084 bash[40692]: --> Failed to activate any OSD(s) 2023-07-13T01:42:01.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:01 smithi103 bash[27315]: cluster 1689212520.4815056 mgr.a (mgr.14152) 365 : cluster 0 pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:01.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:01 smithi084 bash[27323]: cluster 1689212520.4815056 mgr.a (mgr.14152) 365 : cluster 0 pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:01.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:01 smithi022 bash[26979]: cluster 1689212520.4815056 mgr.a (mgr.14152) 365 : cluster 0 pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:02.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:01 smithi154 bash[27744]: cluster 1689212520.4815056 mgr.a (mgr.14152) 365 : cluster 0 pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:02.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:01 smithi137 bash[27262]: cluster 1689212520.4815056 mgr.a (mgr.14152) 365 : cluster 0 pgmap v274: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:03.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:03 smithi103 bash[27315]: cluster 1689212522.4819486 mgr.a (mgr.14152) 366 : cluster 0 pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:03.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:03 smithi103 bash[27315]: audit 1689212523.40255 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-13T01:42:03.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:03 smithi103 bash[27315]: audit 1689212523.4044576 mon.a (mon.0) 595 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:03.897 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:03 smithi084 bash[40897]: debug 2023-07-13T01:42:03.650+0000 7f356cbaa700 1 -- 172.21.15.84:0/3453574140 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555e7731ad00 con 0x555e77370800 2023-07-13T01:42:03.897 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:03 smithi084 bash[40897]: debug 2023-07-13T01:42:03.654+0000 7f3575d2f640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:03.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:03 smithi084 bash[27323]: cluster 1689212522.4819486 mgr.a (mgr.14152) 366 : cluster 0 pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:03.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:03 smithi084 bash[27323]: audit 1689212523.40255 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-13T01:42:03.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:03 smithi084 bash[27323]: audit 1689212523.4044576 mon.a (mon.0) 595 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:03.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:03 smithi022 bash[26979]: cluster 1689212522.4819486 mgr.a (mgr.14152) 366 : cluster 0 pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:03.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:03 smithi022 bash[26979]: audit 1689212523.40255 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-13T01:42:03.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:03 smithi022 bash[26979]: audit 1689212523.4044576 mon.a (mon.0) 595 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:04.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:03 smithi154 bash[27744]: cluster 1689212522.4819486 mgr.a (mgr.14152) 366 : cluster 0 pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:04.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:03 smithi154 bash[27744]: audit 1689212523.40255 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-13T01:42:04.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:03 smithi154 bash[27744]: audit 1689212523.4044576 mon.a (mon.0) 595 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:04.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:03 smithi137 bash[27262]: cluster 1689212522.4819486 mgr.a (mgr.14152) 366 : cluster 0 pgmap v275: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:04.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:03 smithi137 bash[27262]: audit 1689212523.40255 mon.a (mon.0) 594 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-13T01:42:04.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:03 smithi137 bash[27262]: audit 1689212523.4044576 mon.a (mon.0) 595 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:04.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:04 smithi103 bash[27315]: cephadm 1689212523.4057505 mgr.a (mgr.14152) 367 : cephadm 1 Deploying daemon osd.5 on smithi084 2023-07-13T01:42:04.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:04 smithi084 bash[27323]: cephadm 1689212523.4057505 mgr.a (mgr.14152) 367 : cephadm 1 Deploying daemon osd.5 on smithi084 2023-07-13T01:42:04.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:04 smithi022 bash[26979]: cephadm 1689212523.4057505 mgr.a (mgr.14152) 367 : cephadm 1 Deploying daemon osd.5 on smithi084 2023-07-13T01:42:05.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:04 smithi154 bash[27744]: cephadm 1689212523.4057505 mgr.a (mgr.14152) 367 : cephadm 1 Deploying daemon osd.5 on smithi084 2023-07-13T01:42:05.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:04 smithi137 bash[27262]: cephadm 1689212523.4057505 mgr.a (mgr.14152) 367 : cephadm 1 Deploying daemon osd.5 on smithi084 2023-07-13T01:42:05.248 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:04 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:05.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:05 smithi103 bash[27315]: cluster 1689212524.4824321 mgr.a (mgr.14152) 368 : cluster 0 pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:05.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:05 smithi084 bash[27323]: cluster 1689212524.4824321 mgr.a (mgr.14152) 368 : cluster 0 pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:05.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:05 smithi022 bash[26979]: cluster 1689212524.4824321 mgr.a (mgr.14152) 368 : cluster 0 pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:06.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:05 smithi154 bash[27744]: cluster 1689212524.4824321 mgr.a (mgr.14152) 368 : cluster 0 pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:06.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:05 smithi137 bash[27262]: cluster 1689212524.4824321 mgr.a (mgr.14152) 368 : cluster 0 pgmap v276: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:07.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:07 smithi103 bash[27315]: cluster 1689212526.4829044 mgr.a (mgr.14152) 369 : cluster 0 pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:07.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:07 smithi084 bash[27323]: cluster 1689212526.4829044 mgr.a (mgr.14152) 369 : cluster 0 pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:07.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:07 smithi022 bash[26979]: cluster 1689212526.4829044 mgr.a (mgr.14152) 369 : cluster 0 pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:08.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:07 smithi154 bash[27744]: cluster 1689212526.4829044 mgr.a (mgr.14152) 369 : cluster 0 pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:08.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:07 smithi137 bash[27262]: cluster 1689212526.4829044 mgr.a (mgr.14152) 369 : cluster 0 pgmap v277: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:08.542 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:08 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:42:09.146 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:08 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:42:09.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:08 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:09.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:08 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:09.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:09 smithi103 bash[27315]: cluster 1689212528.4832873 mgr.a (mgr.14152) 370 : cluster 0 pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:09.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:09 smithi084 bash[27323]: cluster 1689212528.4832873 mgr.a (mgr.14152) 370 : cluster 0 pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:09.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:09 smithi022 bash[26979]: cluster 1689212528.4832873 mgr.a (mgr.14152) 370 : cluster 0 pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:10.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:09 smithi154 bash[27744]: cluster 1689212528.4832873 mgr.a (mgr.14152) 370 : cluster 0 pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:10.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:09 smithi137 bash[27262]: cluster 1689212528.4832873 mgr.a (mgr.14152) 370 : cluster 0 pgmap v278: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:11.146 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:10 smithi084 bash[41385]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:11.146 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:10 smithi084 bash[41385]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:11.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:10 smithi084 bash[41385]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:11.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:10 smithi084 bash[41385]: --> Failed to activate any OSD(s) 2023-07-13T01:42:12.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:11 smithi154 bash[27744]: cluster 1689212530.4837606 mgr.a (mgr.14152) 371 : cluster 0 pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:12.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:11 smithi154 bash[27744]: audit 1689212530.7386272 mon.a (mon.0) 596 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:11 smithi154 bash[27744]: audit 1689212530.7463615 mon.a (mon.0) 597 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:11 smithi154 bash[27744]: audit 1689212530.7791195 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:12.024 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:11 smithi084 bash[27323]: cluster 1689212530.4837606 mgr.a (mgr.14152) 371 : cluster 0 pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:12.024 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:11 smithi084 bash[27323]: audit 1689212530.7386272 mon.a (mon.0) 596 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.024 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:11 smithi084 bash[27323]: audit 1689212530.7463615 mon.a (mon.0) 597 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.025 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:11 smithi084 bash[27323]: audit 1689212530.7791195 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:12.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:11 smithi137 bash[27262]: cluster 1689212530.4837606 mgr.a (mgr.14152) 371 : cluster 0 pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:12.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:11 smithi137 bash[27262]: audit 1689212530.7386272 mon.a (mon.0) 596 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:11 smithi137 bash[27262]: audit 1689212530.7463615 mon.a (mon.0) 597 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:11 smithi137 bash[27262]: audit 1689212530.7791195 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:12.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:11 smithi103 bash[27315]: cluster 1689212530.4837606 mgr.a (mgr.14152) 371 : cluster 0 pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:12.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:11 smithi103 bash[27315]: audit 1689212530.7386272 mon.a (mon.0) 596 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:11 smithi103 bash[27315]: audit 1689212530.7463615 mon.a (mon.0) 597 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:11 smithi103 bash[27315]: audit 1689212530.7791195 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:12.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:11 smithi022 bash[26979]: cluster 1689212530.4837606 mgr.a (mgr.14152) 371 : cluster 0 pgmap v279: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:12.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:11 smithi022 bash[26979]: audit 1689212530.7386272 mon.a (mon.0) 596 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:11 smithi022 bash[26979]: audit 1689212530.7463615 mon.a (mon.0) 597 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:12.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:11 smithi022 bash[26979]: audit 1689212530.7791195 mon.a (mon.0) 598 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:14.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:13 smithi154 bash[27744]: cluster 1689212532.484212 mgr.a (mgr.14152) 372 : cluster 0 pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:14.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:13 smithi137 bash[27262]: cluster 1689212532.484212 mgr.a (mgr.14152) 372 : cluster 0 pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:14.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:13 smithi103 bash[27315]: cluster 1689212532.484212 mgr.a (mgr.14152) 372 : cluster 0 pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:14.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:13 smithi084 bash[27323]: cluster 1689212532.484212 mgr.a (mgr.14152) 372 : cluster 0 pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:14.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:13 smithi084 bash[41632]: debug 2023-07-13T01:42:13.894+0000 7f51618a5700 1 -- 172.21.15.84:0/263879316 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dca902ed00 con 0x55dca9084800 2023-07-13T01:42:14.147 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:13 smithi084 bash[41632]: debug 2023-07-13T01:42:13.898+0000 7f516aa2a640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:14.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:13 smithi022 bash[26979]: cluster 1689212532.484212 mgr.a (mgr.14152) 372 : cluster 0 pgmap v280: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:15.646 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:15 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:16.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:15 smithi154 bash[27744]: cluster 1689212534.4847047 mgr.a (mgr.14152) 373 : cluster 0 pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:16.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:15 smithi137 bash[27262]: cluster 1689212534.4847047 mgr.a (mgr.14152) 373 : cluster 0 pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:16.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:15 smithi103 bash[27315]: cluster 1689212534.4847047 mgr.a (mgr.14152) 373 : cluster 0 pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:16.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:15 smithi084 bash[27323]: cluster 1689212534.4847047 mgr.a (mgr.14152) 373 : cluster 0 pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:16.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:15 smithi022 bash[26979]: cluster 1689212534.4847047 mgr.a (mgr.14152) 373 : cluster 0 pgmap v281: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:18.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:17 smithi154 bash[27744]: cluster 1689212536.4851966 mgr.a (mgr.14152) 374 : cluster 0 pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:18.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:17 smithi137 bash[27262]: cluster 1689212536.4851966 mgr.a (mgr.14152) 374 : cluster 0 pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:18.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:17 smithi103 bash[27315]: cluster 1689212536.4851966 mgr.a (mgr.14152) 374 : cluster 0 pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:18.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:17 smithi084 bash[27323]: cluster 1689212536.4851966 mgr.a (mgr.14152) 374 : cluster 0 pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:18.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:17 smithi022 bash[26979]: cluster 1689212536.4851966 mgr.a (mgr.14152) 374 : cluster 0 pgmap v282: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:18.646 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:18 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:42:18.646 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:18 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:18.646 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:18 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:19.049 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:18 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:42:19.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:19 smithi137 bash[27262]: audit 1689212538.0448182 mon.a (mon.0) 599 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:19 smithi137 bash[27262]: audit 1689212538.0532186 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:19 smithi137 bash[27262]: audit 1689212538.5239136 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:19.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:19 smithi137 bash[27262]: audit 1689212538.5256703 mon.a (mon.0) 602 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:19.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:19 smithi137 bash[27262]: audit 1689212538.5378582 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:19 smithi103 bash[27315]: audit 1689212538.0448182 mon.a (mon.0) 599 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:19 smithi103 bash[27315]: audit 1689212538.0532186 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:19 smithi103 bash[27315]: audit 1689212538.5239136 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:19.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:19 smithi103 bash[27315]: audit 1689212538.5256703 mon.a (mon.0) 602 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:19.357 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:19 smithi103 bash[27315]: audit 1689212538.5378582 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:19 smithi084 bash[27323]: audit 1689212538.0448182 mon.a (mon.0) 599 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:19 smithi084 bash[27323]: audit 1689212538.0532186 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:19 smithi084 bash[27323]: audit 1689212538.5239136 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:19.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:19 smithi084 bash[27323]: audit 1689212538.5256703 mon.a (mon.0) 602 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:19.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:19 smithi084 bash[27323]: audit 1689212538.5378582 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:19 smithi022 bash[26979]: audit 1689212538.0448182 mon.a (mon.0) 599 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:19 smithi022 bash[26979]: audit 1689212538.0532186 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:19 smithi022 bash[26979]: audit 1689212538.5239136 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:19.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:19 smithi022 bash[26979]: audit 1689212538.5256703 mon.a (mon.0) 602 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:19.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:19 smithi022 bash[26979]: audit 1689212538.5378582 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:19 smithi154 bash[27744]: audit 1689212538.0448182 mon.a (mon.0) 599 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:19 smithi154 bash[27744]: audit 1689212538.0532186 mon.a (mon.0) 600 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:19.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:19 smithi154 bash[27744]: audit 1689212538.5239136 mon.a (mon.0) 601 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:19.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:19 smithi154 bash[27744]: audit 1689212538.5256703 mon.a (mon.0) 602 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:19.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:19 smithi154 bash[27744]: audit 1689212538.5378582 mon.a (mon.0) 603 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:20.102 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[27323]: cluster 1689212538.4856298 mgr.a (mgr.14152) 375 : cluster 0 pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.102 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[27323]: cluster 1689212538.529076 mgr.a (mgr.14152) 376 : cluster 0 pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.102 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[27323]: cluster 1689212538.5293808 mgr.a (mgr.14152) 377 : cluster 0 pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.102 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[27323]: cluster 1689212539.049363 mon.a (mon.0) 604 : cluster 3 Health check update: 6 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:42:20.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:20 smithi137 bash[27262]: cluster 1689212538.4856298 mgr.a (mgr.14152) 375 : cluster 0 pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:20 smithi137 bash[27262]: cluster 1689212538.529076 mgr.a (mgr.14152) 376 : cluster 0 pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:20 smithi137 bash[27262]: cluster 1689212538.5293808 mgr.a (mgr.14152) 377 : cluster 0 pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:20 smithi137 bash[27262]: cluster 1689212539.049363 mon.a (mon.0) 604 : cluster 3 Health check update: 6 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:42:20.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:20 smithi103 bash[27315]: cluster 1689212538.4856298 mgr.a (mgr.14152) 375 : cluster 0 pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:20 smithi103 bash[27315]: cluster 1689212538.529076 mgr.a (mgr.14152) 376 : cluster 0 pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:20 smithi103 bash[27315]: cluster 1689212538.5293808 mgr.a (mgr.14152) 377 : cluster 0 pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:20 smithi103 bash[27315]: cluster 1689212539.049363 mon.a (mon.0) 604 : cluster 3 Health check update: 6 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:42:20.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:20 smithi022 bash[26979]: cluster 1689212538.4856298 mgr.a (mgr.14152) 375 : cluster 0 pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:20 smithi022 bash[26979]: cluster 1689212538.529076 mgr.a (mgr.14152) 376 : cluster 0 pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:20 smithi022 bash[26979]: cluster 1689212538.5293808 mgr.a (mgr.14152) 377 : cluster 0 pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:20 smithi022 bash[26979]: cluster 1689212539.049363 mon.a (mon.0) 604 : cluster 3 Health check update: 6 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:42:20.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:20 smithi154 bash[27744]: cluster 1689212538.4856298 mgr.a (mgr.14152) 375 : cluster 0 pgmap v283: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:20 smithi154 bash[27744]: cluster 1689212538.529076 mgr.a (mgr.14152) 376 : cluster 0 pgmap v284: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:20 smithi154 bash[27744]: cluster 1689212538.5293808 mgr.a (mgr.14152) 377 : cluster 0 pgmap v285: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:20.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:20 smithi154 bash[27744]: cluster 1689212539.049363 mon.a (mon.0) 604 : cluster 3 Health check update: 6 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:42:20.896 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[42405]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:20.896 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[42405]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:20.896 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[42405]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:20.897 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:20 smithi084 bash[42405]: --> Failed to activate any OSD(s) 2023-07-13T01:42:22.103 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:22 smithi084 bash[27323]: cluster 1689212540.5298052 mgr.a (mgr.14152) 378 : cluster 0 pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:22.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:22 smithi137 bash[27262]: cluster 1689212540.5298052 mgr.a (mgr.14152) 378 : cluster 0 pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:22.356 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:22 smithi103 bash[27315]: cluster 1689212540.5298052 mgr.a (mgr.14152) 378 : cluster 0 pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:22.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:22 smithi022 bash[26979]: cluster 1689212540.5298052 mgr.a (mgr.14152) 378 : cluster 0 pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:22.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:22 smithi154 bash[27744]: cluster 1689212540.5298052 mgr.a (mgr.14152) 378 : cluster 0 pgmap v286: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:23.619 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:23 smithi084 bash[42664]: debug 2023-07-13T01:42:23.413+0000 7f716ece4700 1 -- 172.21.15.84:0/3609110795 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561e3b9b4d00 con 0x561e3ba0ac00 2023-07-13T01:42:23.620 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:23 smithi084 bash[42664]: debug 2023-07-13T01:42:23.413+0000 7f7177e69640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:24.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:24 smithi137 bash[27262]: cluster 1689212542.5302553 mgr.a (mgr.14152) 379 : cluster 0 pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:24.355 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:24 smithi103 bash[27315]: cluster 1689212542.5302553 mgr.a (mgr.14152) 379 : cluster 0 pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:24.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:24 smithi084 bash[27323]: cluster 1689212542.5302553 mgr.a (mgr.14152) 379 : cluster 0 pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:24.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:24 smithi022 bash[26979]: cluster 1689212542.5302553 mgr.a (mgr.14152) 379 : cluster 0 pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:24.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:24 smithi154 bash[27744]: cluster 1689212542.5302553 mgr.a (mgr.14152) 379 : cluster 0 pgmap v287: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:24.728 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 5 on host 'smithi084' 2023-07-13T01:42:24.926 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:24 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:25.932 DEBUG:teuthology.orchestra.run.smithi084:osd.5> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service 2023-07-13T01:42:25.935 INFO:tasks.cephadm:Deploying osd.6 on smithi103 with /dev/vg_nvme/lv_4... 2023-07-13T01:42:25.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-13T01:42:25.944 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:25 smithi084 bash[27323]: cluster 1689212544.5307286 mgr.a (mgr.14152) 380 : cluster 0 pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:25.944 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:25 smithi084 bash[27323]: audit 1689212544.7009463 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:25.944 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:25 smithi084 bash[27323]: audit 1689212544.709041 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:25.944 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:25 smithi084 bash[27323]: audit 1689212544.719461 mon.a (mon.0) 607 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:25.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:25 smithi103 bash[27315]: cluster 1689212544.5307286 mgr.a (mgr.14152) 380 : cluster 0 pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:25.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:25 smithi103 bash[27315]: audit 1689212544.7009463 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:25.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:25 smithi103 bash[27315]: audit 1689212544.709041 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:25.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:25 smithi103 bash[27315]: audit 1689212544.719461 mon.a (mon.0) 607 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:26.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:25 smithi154 bash[27744]: cluster 1689212544.5307286 mgr.a (mgr.14152) 380 : cluster 0 pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:26.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:25 smithi154 bash[27744]: audit 1689212544.7009463 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:26.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:25 smithi154 bash[27744]: audit 1689212544.709041 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:26.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:25 smithi154 bash[27744]: audit 1689212544.719461 mon.a (mon.0) 607 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:26.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:25 smithi137 bash[27262]: cluster 1689212544.5307286 mgr.a (mgr.14152) 380 : cluster 0 pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:26.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:25 smithi137 bash[27262]: audit 1689212544.7009463 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:26.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:25 smithi137 bash[27262]: audit 1689212544.709041 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:26.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:25 smithi137 bash[27262]: audit 1689212544.719461 mon.a (mon.0) 607 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:26.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:25 smithi022 bash[26979]: cluster 1689212544.5307286 mgr.a (mgr.14152) 380 : cluster 0 pgmap v288: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:26.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:25 smithi022 bash[26979]: audit 1689212544.7009463 mon.a (mon.0) 605 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:26.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:25 smithi022 bash[26979]: audit 1689212544.709041 mon.a (mon.0) 606 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:26.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:25 smithi022 bash[26979]: audit 1689212544.719461 mon.a (mon.0) 607 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:42:26.258 INFO:journalctl@ceph.osd.5.smithi084.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:42:27.646 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:27 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:42:28.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:27 smithi154 bash[27744]: cluster 1689212546.531183 mgr.a (mgr.14152) 381 : cluster 0 pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:28.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:27 smithi137 bash[27262]: cluster 1689212546.531183 mgr.a (mgr.14152) 381 : cluster 0 pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:28.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:27 smithi103 bash[27315]: cluster 1689212546.531183 mgr.a (mgr.14152) 381 : cluster 0 pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:28.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:27 smithi084 bash[27323]: cluster 1689212546.531183 mgr.a (mgr.14152) 381 : cluster 0 pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:28.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:27 smithi022 bash[26979]: cluster 1689212546.531183 mgr.a (mgr.14152) 381 : cluster 0 pgmap v289: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:29.396 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:28 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:42:29.396 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:28 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:29.396 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:28 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:30.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:29 smithi154 bash[27744]: cluster 1689212548.531615 mgr.a (mgr.14152) 382 : cluster 0 pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:30.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:29 smithi137 bash[27262]: cluster 1689212548.531615 mgr.a (mgr.14152) 382 : cluster 0 pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:30.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:29 smithi103 bash[27315]: cluster 1689212548.531615 mgr.a (mgr.14152) 382 : cluster 0 pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:30.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:29 smithi084 bash[27323]: cluster 1689212548.531615 mgr.a (mgr.14152) 382 : cluster 0 pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:30.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:29 smithi022 bash[26979]: cluster 1689212548.531615 mgr.a (mgr.14152) 382 : cluster 0 pgmap v290: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:30.625 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.c/config 2023-07-13T01:42:30.685 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:30 smithi084 bash[43084]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:30.685 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:30 smithi084 bash[43084]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:30.685 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:30 smithi084 bash[43084]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:30.686 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:30 smithi084 bash[43084]: --> Failed to activate any OSD(s) 2023-07-13T01:42:31.838 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:31 smithi103 bash[27315]: cluster 1689212550.5320697 mgr.a (mgr.14152) 383 : cluster 0 pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:32.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:31 smithi154 bash[27744]: cluster 1689212550.5320697 mgr.a (mgr.14152) 383 : cluster 0 pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:32.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:31 smithi137 bash[27262]: cluster 1689212550.5320697 mgr.a (mgr.14152) 383 : cluster 0 pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:31 smithi022 bash[26979]: cluster 1689212550.5320697 mgr.a (mgr.14152) 383 : cluster 0 pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:32.201 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:31 smithi084 bash[27323]: cluster 1689212550.5320697 mgr.a (mgr.14152) 383 : cluster 0 pgmap v291: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:32.202 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:31 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:42:32.202 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:31 smithi084 systemd[1]: Stopped Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:32.202 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:31 smithi084 systemd[1]: Started Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:33.989 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-13T01:42:33.989 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-13T01:42:33.989 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2023-07-13T01:42:33.989 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2023-07-13T01:42:33.989 INFO:teuthology.orchestra.run.smithi103.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0158542 s, 661 MB/s 2023-07-13T01:42:33.990 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 2023-07-13T01:42:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2023-07-13T01:42:34.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:33 smithi154 bash[27744]: cluster 1689212552.532553 mgr.a (mgr.14152) 384 : cluster 0 pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:34.051 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:33 smithi103 bash[27315]: cluster 1689212552.532553 mgr.a (mgr.14152) 384 : cluster 0 pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:34.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:33 smithi137 bash[27262]: cluster 1689212552.532553 mgr.a (mgr.14152) 384 : cluster 0 pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:34.119 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:33 smithi084 bash[27323]: cluster 1689212552.532553 mgr.a (mgr.14152) 384 : cluster 0 pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:34.120 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:33 smithi084 bash[43201]: debug 2023-07-13T01:42:33.793+0000 7f903a0d5700 1 -- 172.21.15.84:0/2018367697 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c4e0c90d00 con 0x55c4e0ce7000 2023-07-13T01:42:34.120 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:33 smithi084 bash[43201]: debug 2023-07-13T01:42:33.845+0000 7f904325a640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:34.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:33 smithi022 bash[26979]: cluster 1689212552.532553 mgr.a (mgr.14152) 384 : cluster 0 pgmap v292: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:34.620 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:34 smithi084 bash[43303]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:34.620 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:34 smithi084 bash[43303]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:34.621 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:34 smithi084 bash[43303]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:34.621 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:34 smithi084 bash[43303]: --> Failed to activate any OSD(s) 2023-07-13T01:42:34.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2023-07-13T01:42:35.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:35 smithi137 bash[27262]: cluster 1689212554.5329998 mgr.a (mgr.14152) 385 : cluster 0 pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:35.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:35 smithi103 bash[27315]: cluster 1689212554.5329998 mgr.a (mgr.14152) 385 : cluster 0 pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:35.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:35 smithi084 bash[27323]: cluster 1689212554.5329998 mgr.a (mgr.14152) 385 : cluster 0 pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:35.896 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:35 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:35.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:35 smithi022 bash[26979]: cluster 1689212554.5329998 mgr.a (mgr.14152) 385 : cluster 0 pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:36.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:35 smithi154 bash[27744]: cluster 1689212554.5329998 mgr.a (mgr.14152) 385 : cluster 0 pgmap v293: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:37.540 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:37 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:42:37.540 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:37 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:37.540 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:37 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:37.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:37 smithi137 bash[27262]: cluster 1689212556.5334425 mgr.a (mgr.14152) 386 : cluster 0 pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:37.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:37 smithi103 bash[27315]: cluster 1689212556.5334425 mgr.a (mgr.14152) 386 : cluster 0 pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:37.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:37 smithi084 bash[27323]: cluster 1689212556.5334425 mgr.a (mgr.14152) 386 : cluster 0 pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:37.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:37 smithi022 bash[26979]: cluster 1689212556.5334425 mgr.a (mgr.14152) 386 : cluster 0 pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:38.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:37 smithi154 bash[27744]: cluster 1689212556.5334425 mgr.a (mgr.14152) 386 : cluster 0 pgmap v294: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:38.882 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:38 smithi084 bash[43616]: debug 2023-07-13T01:42:38.769+0000 7fed05dd4700 1 -- 172.21.15.84:0/2710532584 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563014d4ed00 con 0x563014da5000 2023-07-13T01:42:38.882 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:38 smithi084 bash[43616]: debug 2023-07-13T01:42:38.769+0000 7fed0ef59640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:39.439 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.c/config 2023-07-13T01:42:39.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: cluster 1689212558.5339036 mgr.a (mgr.14152) 387 : cluster 0 pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: cephadm 1689212558.5754511 mgr.a (mgr.14152) 388 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:42:39.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.5856194 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.5931654 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.5947933 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.5962868 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.597704 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: cephadm 1689212558.598795 mgr.a (mgr.14152) 389 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:42:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.6058125 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.6072743 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:39.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.608568 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:39.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: cluster 1689212558.6112738 mgr.a (mgr.14152) 390 : cluster 0 pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: cluster 1689212558.611598 mgr.a (mgr.14152) 391 : cluster 0 pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:39 smithi103 bash[27315]: audit 1689212558.617072 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: cluster 1689212558.5339036 mgr.a (mgr.14152) 387 : cluster 0 pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: cephadm 1689212558.5754511 mgr.a (mgr.14152) 388 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:42:39.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.5856194 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.5931654 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.5947933 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.5962868 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.597704 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: cephadm 1689212558.598795 mgr.a (mgr.14152) 389 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.6058125 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.6072743 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.608568 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:39.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: cluster 1689212558.6112738 mgr.a (mgr.14152) 390 : cluster 0 pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: cluster 1689212558.611598 mgr.a (mgr.14152) 391 : cluster 0 pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[27323]: audit 1689212558.617072 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.898 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[44284]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:39.898 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[44284]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:39.898 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[44284]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:39.899 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:39 smithi084 bash[44284]: --> Failed to activate any OSD(s) 2023-07-13T01:42:39.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: cluster 1689212558.5339036 mgr.a (mgr.14152) 387 : cluster 0 pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: cephadm 1689212558.5754511 mgr.a (mgr.14152) 388 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:42:39.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.5856194 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.5931654 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.5947933 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.5962868 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.597704 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:39.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: cephadm 1689212558.598795 mgr.a (mgr.14152) 389 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:42:39.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.6058125 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:39.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.6072743 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:39.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.608568 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:39.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: cluster 1689212558.6112738 mgr.a (mgr.14152) 390 : cluster 0 pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: cluster 1689212558.611598 mgr.a (mgr.14152) 391 : cluster 0 pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:39.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:39 smithi022 bash[26979]: audit 1689212558.617072 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: cluster 1689212558.5339036 mgr.a (mgr.14152) 387 : cluster 0 pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:40.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: cephadm 1689212558.5754511 mgr.a (mgr.14152) 388 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:42:40.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.5856194 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.5931654 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.5947933 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:40.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.5962868 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.597704 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: cephadm 1689212558.598795 mgr.a (mgr.14152) 389 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.6058125 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.6072743 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.608568 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: cluster 1689212558.6112738 mgr.a (mgr.14152) 390 : cluster 0 pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:40.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: cluster 1689212558.611598 mgr.a (mgr.14152) 391 : cluster 0 pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:40.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:39 smithi154 bash[27744]: audit 1689212558.617072 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: cluster 1689212558.5339036 mgr.a (mgr.14152) 387 : cluster 0 pgmap v295: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:40.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: cephadm 1689212558.5754511 mgr.a (mgr.14152) 388 : cephadm 1 Detected new or changed devices on smithi084 2023-07-13T01:42:40.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.5856194 mon.a (mon.0) 608 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.5931654 mon.a (mon.0) 609 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.5947933 mon.a (mon.0) 610 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:40.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.5962868 mon.a (mon.0) 611 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:40.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.597704 mon.a (mon.0) 612 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:42:40.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: cephadm 1689212558.598795 mgr.a (mgr.14152) 389 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:42:40.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.6058125 mon.a (mon.0) 613 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.6072743 mon.a (mon.0) 614 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:40.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.608568 mon.a (mon.0) 615 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:42:40.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: cluster 1689212558.6112738 mgr.a (mgr.14152) 390 : cluster 0 pgmap v296: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:40.061 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: cluster 1689212558.611598 mgr.a (mgr.14152) 391 : cluster 0 pgmap v297: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:40.062 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:39 smithi137 bash[27262]: audit 1689212558.617072 mon.a (mon.0) 616 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:42:40.645 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:40 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:41.179 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:40 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:42:41.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:41 smithi103 bash[27315]: cluster 1689212560.6120296 mgr.a (mgr.14152) 392 : cluster 0 pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:42.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:41 smithi154 bash[27744]: cluster 1689212560.6120296 mgr.a (mgr.14152) 392 : cluster 0 pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:42.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:41 smithi137 bash[27262]: cluster 1689212560.6120296 mgr.a (mgr.14152) 392 : cluster 0 pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:42.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:41 smithi084 bash[27323]: cluster 1689212560.6120296 mgr.a (mgr.14152) 392 : cluster 0 pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:42.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:41 smithi022 bash[26979]: cluster 1689212560.6120296 mgr.a (mgr.14152) 392 : cluster 0 pgmap v298: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:42.912 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:42 smithi084 bash[44614]: debug 2023-07-13T01:42:42.525+0000 7f4be49dd700 1 -- 172.21.15.84:0/3152525889 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558336bf4d00 con 0x558336c4ac00 2023-07-13T01:42:42.913 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:42 smithi084 bash[44614]: debug 2023-07-13T01:42:42.529+0000 7f4bedb62640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:43.896 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:43 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:43.896 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:43 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2023-07-13T01:42:43.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:43 smithi084 bash[27323]: cluster 1689212562.6125784 mgr.a (mgr.14152) 393 : cluster 0 pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:43.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:43 smithi084 bash[27323]: audit 1689212562.7491338 mgr.a (mgr.14152) 394 : audit 0 from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:42:43.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:43 smithi084 bash[27323]: audit 1689212562.7566614 mon.a (mon.0) 617 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:42:43.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:43 smithi084 bash[27323]: audit 1689212562.7636917 mon.a (mon.0) 618 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:42:43.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:43 smithi084 bash[27323]: audit 1689212562.7651658 mon.a (mon.0) 619 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:44.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:43 smithi154 bash[27744]: cluster 1689212562.6125784 mgr.a (mgr.14152) 393 : cluster 0 pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:44.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:43 smithi154 bash[27744]: audit 1689212562.7491338 mgr.a (mgr.14152) 394 : audit 0 from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:42:44.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:43 smithi154 bash[27744]: audit 1689212562.7566614 mon.a (mon.0) 617 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:42:44.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:43 smithi154 bash[27744]: audit 1689212562.7636917 mon.a (mon.0) 618 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:42:44.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:43 smithi154 bash[27744]: audit 1689212562.7651658 mon.a (mon.0) 619 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:44.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:43 smithi137 bash[27262]: cluster 1689212562.6125784 mgr.a (mgr.14152) 393 : cluster 0 pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:44.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:43 smithi137 bash[27262]: audit 1689212562.7491338 mgr.a (mgr.14152) 394 : audit 0 from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:42:44.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:43 smithi137 bash[27262]: audit 1689212562.7566614 mon.a (mon.0) 617 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:42:44.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:43 smithi137 bash[27262]: audit 1689212562.7636917 mon.a (mon.0) 618 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:42:44.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:43 smithi137 bash[27262]: audit 1689212562.7651658 mon.a (mon.0) 619 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:43 smithi103 bash[27315]: cluster 1689212562.6125784 mgr.a (mgr.14152) 393 : cluster 0 pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:43 smithi103 bash[27315]: audit 1689212562.7491338 mgr.a (mgr.14152) 394 : audit 0 from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:42:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:43 smithi103 bash[27315]: audit 1689212562.7566614 mon.a (mon.0) 617 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:42:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:43 smithi103 bash[27315]: audit 1689212562.7636917 mon.a (mon.0) 618 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:42:44.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:43 smithi103 bash[27315]: audit 1689212562.7651658 mon.a (mon.0) 619 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:44.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:43 smithi022 bash[26979]: cluster 1689212562.6125784 mgr.a (mgr.14152) 393 : cluster 0 pgmap v299: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:44.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:43 smithi022 bash[26979]: audit 1689212562.7491338 mgr.a (mgr.14152) 394 : audit 0 from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:42:44.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:43 smithi022 bash[26979]: audit 1689212562.7566614 mon.a (mon.0) 617 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:42:44.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:43 smithi022 bash[26979]: audit 1689212562.7636917 mon.a (mon.0) 618 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:42:44.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:43 smithi022 bash[26979]: audit 1689212562.7651658 mon.a (mon.0) 619 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:42:45.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:45 smithi084 bash[27323]: cluster 1689212564.6130557 mgr.a (mgr.14152) 395 : cluster 0 pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:45.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:45 smithi137 bash[27262]: cluster 1689212564.6130557 mgr.a (mgr.14152) 395 : cluster 0 pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:45.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:45 smithi103 bash[27315]: cluster 1689212564.6130557 mgr.a (mgr.14152) 395 : cluster 0 pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:45.895 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:45 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:42:45.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:45 smithi022 bash[26979]: cluster 1689212564.6130557 mgr.a (mgr.14152) 395 : cluster 0 pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:46.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:45 smithi154 bash[27744]: cluster 1689212564.6130557 mgr.a (mgr.14152) 395 : cluster 0 pgmap v300: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:48.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:47 smithi154 bash[27744]: cluster 1689212566.61354 mgr.a (mgr.14152) 396 : cluster 0 pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:48.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:47 smithi137 bash[27262]: cluster 1689212566.61354 mgr.a (mgr.14152) 396 : cluster 0 pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:48.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:47 smithi103 bash[27315]: cluster 1689212566.61354 mgr.a (mgr.14152) 396 : cluster 0 pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:48.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:47 smithi084 bash[27323]: cluster 1689212566.61354 mgr.a (mgr.14152) 396 : cluster 0 pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:48.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:47 smithi022 bash[26979]: cluster 1689212566.61354 mgr.a (mgr.14152) 396 : cluster 0 pgmap v301: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:50.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:49 smithi154 bash[27744]: cluster 1689212568.613982 mgr.a (mgr.14152) 397 : cluster 0 pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:50.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:49 smithi137 bash[27262]: cluster 1689212568.613982 mgr.a (mgr.14152) 397 : cluster 0 pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:50.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:49 smithi103 bash[27315]: cluster 1689212568.613982 mgr.a (mgr.14152) 397 : cluster 0 pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:50.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:49 smithi084 bash[27323]: cluster 1689212568.613982 mgr.a (mgr.14152) 397 : cluster 0 pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:50.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:49 smithi022 bash[26979]: cluster 1689212568.613982 mgr.a (mgr.14152) 397 : cluster 0 pgmap v302: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:51.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:51 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:42:51.646 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:51 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:51.646 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:51 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:52.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: cluster 1689212570.6144316 mgr.a (mgr.14152) 398 : cluster 0 pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:52.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.411797 mon.b (mon.4) 17 : audit 1 from='client.? 172.21.15.103:0/2116368913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.4122975 mon.a (mon.0) 620 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.4219599 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]': finished 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: cluster 1689212571.4221258 mon.a (mon.0) 622 : cluster 0 osdmap e11: 7 total, 0 up, 7 in 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.4224222 mon.a (mon.0) 623 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.422806 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.4230525 mon.a (mon.0) 625 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:42:52.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.4232702 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:42:52.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.423438 mon.a (mon.0) 627 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:42:52.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.423676 mon.a (mon.0) 628 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:42:52.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:51 smithi154 bash[27744]: audit 1689212571.423878 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:42:52.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: cluster 1689212570.6144316 mgr.a (mgr.14152) 398 : cluster 0 pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:52.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.411797 mon.b (mon.4) 17 : audit 1 from='client.? 172.21.15.103:0/2116368913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.4122975 mon.a (mon.0) 620 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.4219599 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]': finished 2023-07-13T01:42:52.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: cluster 1689212571.4221258 mon.a (mon.0) 622 : cluster 0 osdmap e11: 7 total, 0 up, 7 in 2023-07-13T01:42:52.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.4224222 mon.a (mon.0) 623 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:42:52.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.422806 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:42:52.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.4230525 mon.a (mon.0) 625 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:42:52.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.4232702 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:42:52.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.423438 mon.a (mon.0) 627 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:42:52.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.423676 mon.a (mon.0) 628 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:42:52.060 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:51 smithi137 bash[27262]: audit 1689212571.423878 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:42:52.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: cluster 1689212570.6144316 mgr.a (mgr.14152) 398 : cluster 0 pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:52.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.411797 mon.b (mon.4) 17 : audit 1 from='client.? 172.21.15.103:0/2116368913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.4122975 mon.a (mon.0) 620 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.4219599 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]': finished 2023-07-13T01:42:52.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: cluster 1689212571.4221258 mon.a (mon.0) 622 : cluster 0 osdmap e11: 7 total, 0 up, 7 in 2023-07-13T01:42:52.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.4224222 mon.a (mon.0) 623 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:42:52.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.422806 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:42:52.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.4230525 mon.a (mon.0) 625 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:42:52.107 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.4232702 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:42:52.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.423438 mon.a (mon.0) 627 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:42:52.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.423676 mon.a (mon.0) 628 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:42:52.108 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:51 smithi103 bash[27315]: audit 1689212571.423878 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:42:52.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: cluster 1689212570.6144316 mgr.a (mgr.14152) 398 : cluster 0 pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:52.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.411797 mon.b (mon.4) 17 : audit 1 from='client.? 172.21.15.103:0/2116368913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.4122975 mon.a (mon.0) 620 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.4219599 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]': finished 2023-07-13T01:42:52.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: cluster 1689212571.4221258 mon.a (mon.0) 622 : cluster 0 osdmap e11: 7 total, 0 up, 7 in 2023-07-13T01:42:52.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.4224222 mon.a (mon.0) 623 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:42:52.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.422806 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:42:52.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.4230525 mon.a (mon.0) 625 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:42:52.148 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.4232702 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:42:52.148 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.423438 mon.a (mon.0) 627 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:42:52.148 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.423676 mon.a (mon.0) 628 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:42:52.148 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:51 smithi084 bash[27323]: audit 1689212571.423878 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:42:52.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: cluster 1689212570.6144316 mgr.a (mgr.14152) 398 : cluster 0 pgmap v303: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:52.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.411797 mon.b (mon.4) 17 : audit 1 from='client.? 172.21.15.103:0/2116368913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.4122975 mon.a (mon.0) 620 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]: dispatch 2023-07-13T01:42:52.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.4219599 mon.a (mon.0) 621 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed1cbfbf-9dbc-4a48-b8fe-67f653fa8d71"}]': finished 2023-07-13T01:42:52.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: cluster 1689212571.4221258 mon.a (mon.0) 622 : cluster 0 osdmap e11: 7 total, 0 up, 7 in 2023-07-13T01:42:52.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.4224222 mon.a (mon.0) 623 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:42:52.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.422806 mon.a (mon.0) 624 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:42:52.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.4230525 mon.a (mon.0) 625 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:42:52.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.4232702 mon.a (mon.0) 626 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:42:52.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.423438 mon.a (mon.0) 627 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:42:52.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.423676 mon.a (mon.0) 628 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:42:52.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:51 smithi022 bash[26979]: audit 1689212571.423878 mon.a (mon.0) 629 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:42:52.895 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:52 smithi084 bash[27323]: audit 1689212572.1329384 mon.b (mon.4) 18 : audit 0 from='client.? 172.21.15.103:0/448309287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:42:52.896 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:52 smithi084 bash[44948]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:52.896 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:52 smithi084 bash[44948]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:52.896 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:52 smithi084 bash[44948]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:52.896 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:52 smithi084 bash[44948]: --> Failed to activate any OSD(s) 2023-07-13T01:42:53.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:52 smithi154 bash[27744]: audit 1689212572.1329384 mon.b (mon.4) 18 : audit 0 from='client.? 172.21.15.103:0/448309287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:42:53.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:52 smithi137 bash[27262]: audit 1689212572.1329384 mon.b (mon.4) 18 : audit 0 from='client.? 172.21.15.103:0/448309287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:42:53.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:52 smithi103 bash[27315]: audit 1689212572.1329384 mon.b (mon.4) 18 : audit 0 from='client.? 172.21.15.103:0/448309287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:42:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:52 smithi022 bash[26979]: audit 1689212572.1329384 mon.b (mon.4) 18 : audit 0 from='client.? 172.21.15.103:0/448309287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:42:54.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:53 smithi154 bash[27744]: cluster 1689212572.6148803 mgr.a (mgr.14152) 399 : cluster 0 pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:54.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:53 smithi137 bash[27262]: cluster 1689212572.6148803 mgr.a (mgr.14152) 399 : cluster 0 pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:54.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:53 smithi103 bash[27315]: cluster 1689212572.6148803 mgr.a (mgr.14152) 399 : cluster 0 pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:54.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:53 smithi084 bash[27323]: cluster 1689212572.6148803 mgr.a (mgr.14152) 399 : cluster 0 pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:54.146 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:53 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:42:54.146 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:53 smithi084 systemd[1]: Stopped Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:54.146 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:53 smithi084 systemd[1]: Started Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:54.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:53 smithi022 bash[26979]: cluster 1689212572.6148803 mgr.a (mgr.14152) 399 : cluster 0 pgmap v305: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:54.942 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:54 smithi084 bash[45052]: debug 2023-07-13T01:42:54.801+0000 7f9b8716a700 1 -- 172.21.15.84:0/2704261262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f07b1a2d00 con 0x55f07b1f8800 2023-07-13T01:42:54.943 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:54 smithi084 bash[45052]: debug 2023-07-13T01:42:54.801+0000 7f9b902ef640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:55.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:55 smithi084 bash[27323]: cluster 1689212574.615294 mgr.a (mgr.14152) 400 : cluster 0 pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:55.646 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:55 smithi084 bash[45087]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:55.646 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:55 smithi084 bash[45087]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:55.646 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:55 smithi084 bash[45087]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:55.646 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:55 smithi084 bash[45087]: --> Failed to activate any OSD(s) 2023-07-13T01:42:55.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:55 smithi137 bash[27262]: cluster 1689212574.615294 mgr.a (mgr.14152) 400 : cluster 0 pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:55.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:55 smithi103 bash[27315]: cluster 1689212574.615294 mgr.a (mgr.14152) 400 : cluster 0 pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:55.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:55 smithi022 bash[26979]: cluster 1689212574.615294 mgr.a (mgr.14152) 400 : cluster 0 pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:55.972 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:55 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:42:55.972 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:55 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:55.973 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:55 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:42:56.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:55 smithi154 bash[27744]: cluster 1689212574.615294 mgr.a (mgr.14152) 400 : cluster 0 pgmap v306: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:56.395 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:42:55 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:42:58.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:57 smithi154 bash[27744]: cluster 1689212576.6157458 mgr.a (mgr.14152) 401 : cluster 0 pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:58.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:57 smithi137 bash[27262]: cluster 1689212576.6157458 mgr.a (mgr.14152) 401 : cluster 0 pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:58.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:57 smithi103 bash[27315]: cluster 1689212576.6157458 mgr.a (mgr.14152) 401 : cluster 0 pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:58.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:57 smithi084 bash[27323]: cluster 1689212576.6157458 mgr.a (mgr.14152) 401 : cluster 0 pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:58.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:57 smithi022 bash[26979]: cluster 1689212576.6157458 mgr.a (mgr.14152) 401 : cluster 0 pgmap v307: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:42:58.682 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:58 smithi084 bash[45372]: debug 2023-07-13T01:42:58.525+0000 7f533ec07700 1 -- 172.21.15.84:0/381618711 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581c7a3cd00 con 0x5581c7a93000 2023-07-13T01:42:58.682 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:42:58 smithi084 bash[45372]: debug 2023-07-13T01:42:58.525+0000 7f5347d8c640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:42:58.683 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:58 smithi084 bash[45269]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:58.683 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:58 smithi084 bash[45269]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:42:58.684 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:58 smithi084 bash[45269]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:42:58.684 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:42:58 smithi084 bash[45269]: --> Failed to activate any OSD(s) 2023-07-13T01:42:59.976 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:42:59 smithi084 bash[27323]: cluster 1689212578.6161962 mgr.a (mgr.14152) 402 : cluster 0 pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:00.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:42:59 smithi154 bash[27744]: cluster 1689212578.6161962 mgr.a (mgr.14152) 402 : cluster 0 pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:00.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:42:59 smithi137 bash[27262]: cluster 1689212578.6161962 mgr.a (mgr.14152) 402 : cluster 0 pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:00.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:42:59 smithi103 bash[27315]: cluster 1689212578.6161962 mgr.a (mgr.14152) 402 : cluster 0 pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:00.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:42:59 smithi022 bash[26979]: cluster 1689212578.6161962 mgr.a (mgr.14152) 402 : cluster 0 pgmap v308: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:00.232 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:00 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:01.145 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:00 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:43:01.818 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:01 smithi084 bash[45642]: debug 2023-07-13T01:43:01.689+0000 7f81234d8700 1 -- 172.21.15.84:0/598904748 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56118d934d00 con 0x56118d98a800 2023-07-13T01:43:01.819 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:01 smithi084 bash[45642]: debug 2023-07-13T01:43:01.693+0000 7f812c65d640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:01.819 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:01 smithi084 bash[27323]: cluster 1689212580.6166382 mgr.a (mgr.14152) 403 : cluster 0 pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:01.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:01 smithi103 bash[27315]: cluster 1689212580.6166382 mgr.a (mgr.14152) 403 : cluster 0 pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:02.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:01 smithi154 bash[27744]: cluster 1689212580.6166382 mgr.a (mgr.14152) 403 : cluster 0 pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:02.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:01 smithi137 bash[27262]: cluster 1689212580.6166382 mgr.a (mgr.14152) 403 : cluster 0 pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:02.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:01 smithi022 bash[26979]: cluster 1689212580.6166382 mgr.a (mgr.14152) 403 : cluster 0 pgmap v309: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:02.685 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:02 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:03.677 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:03 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2023-07-13T01:43:03.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:03 smithi103 bash[27315]: cluster 1689212582.6171222 mgr.a (mgr.14152) 404 : cluster 0 pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:04.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:03 smithi154 bash[27744]: cluster 1689212582.6171222 mgr.a (mgr.14152) 404 : cluster 0 pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:04.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:03 smithi137 bash[27262]: cluster 1689212582.6171222 mgr.a (mgr.14152) 404 : cluster 0 pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:04.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:03 smithi084 bash[27323]: cluster 1689212582.6171222 mgr.a (mgr.14152) 404 : cluster 0 pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:04.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:03 smithi022 bash[26979]: cluster 1689212582.6171222 mgr.a (mgr.14152) 404 : cluster 0 pgmap v310: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:04.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:04 smithi103 bash[27315]: audit 1689212584.21641 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-13T01:43:04.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:04 smithi103 bash[27315]: audit 1689212584.2182226 mon.a (mon.0) 631 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:04.895 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:04 smithi084 bash[27323]: audit 1689212584.21641 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-13T01:43:04.895 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:04 smithi084 bash[27323]: audit 1689212584.2182226 mon.a (mon.0) 631 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:05.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:04 smithi154 bash[27744]: audit 1689212584.21641 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-13T01:43:05.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:04 smithi154 bash[27744]: audit 1689212584.2182226 mon.a (mon.0) 631 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:05.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:04 smithi137 bash[27262]: audit 1689212584.21641 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-13T01:43:05.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:04 smithi137 bash[27262]: audit 1689212584.2182226 mon.a (mon.0) 631 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:05.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:04 smithi022 bash[26979]: audit 1689212584.21641 mon.a (mon.0) 630 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-13T01:43:05.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:04 smithi022 bash[26979]: audit 1689212584.2182226 mon.a (mon.0) 631 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:05.395 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:04 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:43:06.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:05 smithi154 bash[27744]: cephadm 1689212584.219621 mgr.a (mgr.14152) 405 : cephadm 1 Deploying daemon osd.6 on smithi103 2023-07-13T01:43:06.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:05 smithi154 bash[27744]: cluster 1689212584.6176198 mgr.a (mgr.14152) 406 : cluster 0 pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:06.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:05 smithi137 bash[27262]: cephadm 1689212584.219621 mgr.a (mgr.14152) 405 : cephadm 1 Deploying daemon osd.6 on smithi103 2023-07-13T01:43:06.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:05 smithi137 bash[27262]: cluster 1689212584.6176198 mgr.a (mgr.14152) 406 : cluster 0 pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:06.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:05 smithi103 bash[27315]: cephadm 1689212584.219621 mgr.a (mgr.14152) 405 : cephadm 1 Deploying daemon osd.6 on smithi103 2023-07-13T01:43:06.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:05 smithi103 bash[27315]: cluster 1689212584.6176198 mgr.a (mgr.14152) 406 : cluster 0 pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:06.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:05 smithi084 bash[27323]: cephadm 1689212584.219621 mgr.a (mgr.14152) 405 : cephadm 1 Deploying daemon osd.6 on smithi103 2023-07-13T01:43:06.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:05 smithi084 bash[27323]: cluster 1689212584.6176198 mgr.a (mgr.14152) 406 : cluster 0 pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:06.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:05 smithi022 bash[26979]: cephadm 1689212584.219621 mgr.a (mgr.14152) 405 : cephadm 1 Deploying daemon osd.6 on smithi103 2023-07-13T01:43:06.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:05 smithi022 bash[26979]: cluster 1689212584.6176198 mgr.a (mgr.14152) 406 : cluster 0 pgmap v311: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:08.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:07 smithi154 bash[27744]: cluster 1689212586.6180692 mgr.a (mgr.14152) 407 : cluster 0 pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:08.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:07 smithi137 bash[27262]: cluster 1689212586.6180692 mgr.a (mgr.14152) 407 : cluster 0 pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:08.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:07 smithi103 bash[27315]: cluster 1689212586.6180692 mgr.a (mgr.14152) 407 : cluster 0 pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:08.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:07 smithi084 bash[27323]: cluster 1689212586.6180692 mgr.a (mgr.14152) 407 : cluster 0 pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:08.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:07 smithi022 bash[26979]: cluster 1689212586.6180692 mgr.a (mgr.14152) 407 : cluster 0 pgmap v312: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:10.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:09 smithi103 bash[27315]: cluster 1689212588.6185179 mgr.a (mgr.14152) 408 : cluster 0 pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:10.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:09 smithi103 bash[27315]: audit 1689212588.9203513 mon.a (mon.0) 632 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:09 smithi103 bash[27315]: audit 1689212588.9263463 mon.a (mon.0) 633 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:09 smithi103 bash[27315]: audit 1689212588.9393232 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:10.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:09 smithi103 bash[27315]: audit 1689212589.3190691 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:09 smithi103 bash[27315]: audit 1689212589.3261654 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:09 smithi154 bash[27744]: cluster 1689212588.6185179 mgr.a (mgr.14152) 408 : cluster 0 pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:10.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:09 smithi154 bash[27744]: audit 1689212588.9203513 mon.a (mon.0) 632 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:09 smithi154 bash[27744]: audit 1689212588.9263463 mon.a (mon.0) 633 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:09 smithi154 bash[27744]: audit 1689212588.9393232 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:10.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:09 smithi154 bash[27744]: audit 1689212589.3190691 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.259 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:09 smithi154 bash[27744]: audit 1689212589.3261654 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:09 smithi137 bash[27262]: cluster 1689212588.6185179 mgr.a (mgr.14152) 408 : cluster 0 pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:10.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:09 smithi137 bash[27262]: audit 1689212588.9203513 mon.a (mon.0) 632 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:09 smithi137 bash[27262]: audit 1689212588.9263463 mon.a (mon.0) 633 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:09 smithi137 bash[27262]: audit 1689212588.9393232 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:10.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:09 smithi137 bash[27262]: audit 1689212589.3190691 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:09 smithi137 bash[27262]: audit 1689212589.3261654 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:09 smithi084 bash[27323]: cluster 1689212588.6185179 mgr.a (mgr.14152) 408 : cluster 0 pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:10.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:09 smithi084 bash[27323]: audit 1689212588.9203513 mon.a (mon.0) 632 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:09 smithi084 bash[27323]: audit 1689212588.9263463 mon.a (mon.0) 633 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:09 smithi084 bash[27323]: audit 1689212588.9393232 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:10.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:09 smithi084 bash[27323]: audit 1689212589.3190691 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:09 smithi084 bash[27323]: audit 1689212589.3261654 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:09 smithi022 bash[26979]: cluster 1689212588.6185179 mgr.a (mgr.14152) 408 : cluster 0 pgmap v313: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:10.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:09 smithi022 bash[26979]: audit 1689212588.9203513 mon.a (mon.0) 632 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:09 smithi022 bash[26979]: audit 1689212588.9263463 mon.a (mon.0) 633 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:09 smithi022 bash[26979]: audit 1689212588.9393232 mon.a (mon.0) 634 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:10.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:09 smithi022 bash[26979]: audit 1689212589.3190691 mon.a (mon.0) 635 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:10.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:09 smithi022 bash[26979]: audit 1689212589.3261654 mon.a (mon.0) 636 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:11.395 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:10 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 10. 2023-07-13T01:43:11.395 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:10 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:11.395 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:10 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:12.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:11 smithi103 bash[27315]: cluster 1689212590.6190526 mgr.a (mgr.14152) 409 : cluster 0 pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:12.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:11 smithi154 bash[27744]: cluster 1689212590.6190526 mgr.a (mgr.14152) 409 : cluster 0 pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:12.299 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:11 smithi084 bash[27323]: cluster 1689212590.6190526 mgr.a (mgr.14152) 409 : cluster 0 pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:12.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:11 smithi137 bash[27262]: cluster 1689212590.6190526 mgr.a (mgr.14152) 409 : cluster 0 pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:12.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:11 smithi022 bash[26979]: cluster 1689212590.6190526 mgr.a (mgr.14152) 409 : cluster 0 pgmap v314: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:12.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:12 smithi084 bash[46044]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:12.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:12 smithi084 bash[46044]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:12.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:12 smithi084 bash[46044]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:12.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:12 smithi084 bash[46044]: --> Failed to activate any OSD(s) 2023-07-13T01:43:13.919 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:13 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:43:13.920 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:13 smithi084 systemd[1]: Stopped Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:13.920 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:13 smithi084 systemd[1]: Started Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:14.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:13 smithi103 bash[27315]: cluster 1689212592.6195576 mgr.a (mgr.14152) 410 : cluster 0 pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:14.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:13 smithi084 bash[27323]: cluster 1689212592.6195576 mgr.a (mgr.14152) 410 : cluster 0 pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:14.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:13 smithi154 bash[27744]: cluster 1689212592.6195576 mgr.a (mgr.14152) 410 : cluster 0 pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:14.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:13 smithi137 bash[27262]: cluster 1689212592.6195576 mgr.a (mgr.14152) 410 : cluster 0 pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:13 smithi022 bash[26979]: cluster 1689212592.6195576 mgr.a (mgr.14152) 410 : cluster 0 pgmap v315: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:14.846 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:14 smithi084 bash[46145]: debug 2023-07-13T01:43:14.729+0000 7f461f823700 1 -- 172.21.15.84:0/1720520907 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5566baf38d00 con 0x5566baf8e800 2023-07-13T01:43:14.847 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:14 smithi084 bash[46145]: debug 2023-07-13T01:43:14.729+0000 7f46289a8640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:15.200 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:15 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:43:15.200 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:15 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:15.200 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:15 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:15.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[27323]: audit 1689212594.183804 mon.a (mon.0) 637 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[27323]: audit 1689212594.1906524 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[27323]: audit 1689212594.6613204 mon.a (mon.0) 639 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:15.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[27323]: audit 1689212594.6630812 mon.a (mon.0) 640 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:15.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[27323]: audit 1689212594.6736164 mon.a (mon.0) 641 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:15 smithi154 bash[27744]: audit 1689212594.183804 mon.a (mon.0) 637 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:15 smithi154 bash[27744]: audit 1689212594.1906524 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:15 smithi154 bash[27744]: audit 1689212594.6613204 mon.a (mon.0) 639 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:15.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:15 smithi154 bash[27744]: audit 1689212594.6630812 mon.a (mon.0) 640 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:15.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:15 smithi154 bash[27744]: audit 1689212594.6736164 mon.a (mon.0) 641 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:15 smithi137 bash[27262]: audit 1689212594.183804 mon.a (mon.0) 637 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:15 smithi137 bash[27262]: audit 1689212594.1906524 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:15 smithi137 bash[27262]: audit 1689212594.6613204 mon.a (mon.0) 639 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:15.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:15 smithi137 bash[27262]: audit 1689212594.6630812 mon.a (mon.0) 640 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:15.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:15 smithi137 bash[27262]: audit 1689212594.6736164 mon.a (mon.0) 641 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.557 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:15 smithi103 bash[27315]: audit 1689212594.183804 mon.a (mon.0) 637 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.558 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:15 smithi103 bash[27315]: audit 1689212594.1906524 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.558 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:15 smithi103 bash[27315]: audit 1689212594.6613204 mon.a (mon.0) 639 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:15.558 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:15 smithi103 bash[27315]: audit 1689212594.6630812 mon.a (mon.0) 640 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:15.558 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:15 smithi103 bash[27315]: audit 1689212594.6736164 mon.a (mon.0) 641 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:15 smithi022 bash[26979]: audit 1689212594.183804 mon.a (mon.0) 637 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:15 smithi022 bash[26979]: audit 1689212594.1906524 mon.a (mon.0) 638 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:15.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:15 smithi022 bash[26979]: audit 1689212594.6613204 mon.a (mon.0) 639 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:15.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:15 smithi022 bash[26979]: audit 1689212594.6630812 mon.a (mon.0) 640 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:15.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:15 smithi022 bash[26979]: audit 1689212594.6736164 mon.a (mon.0) 641 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:16.227 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[46179]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:16.228 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[46179]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:16.228 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[46179]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:16.228 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:15 smithi084 bash[46179]: --> Failed to activate any OSD(s) 2023-07-13T01:43:16.228 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:16 smithi084 bash[27323]: cluster 1689212594.6199918 mgr.a (mgr.14152) 411 : cluster 0 pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.229 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:16 smithi084 bash[27323]: cluster 1689212594.6663873 mgr.a (mgr.14152) 412 : cluster 0 pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.229 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:16 smithi084 bash[27323]: cluster 1689212594.6666613 mgr.a (mgr.14152) 413 : cluster 0 pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.229 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:16 smithi084 bash[27323]: cluster 1689212595.551725 mon.a (mon.0) 642 : cluster 3 Health check update: 7 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:43:16.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:16 smithi154 bash[27744]: cluster 1689212594.6199918 mgr.a (mgr.14152) 411 : cluster 0 pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:16 smithi154 bash[27744]: cluster 1689212594.6663873 mgr.a (mgr.14152) 412 : cluster 0 pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:16 smithi154 bash[27744]: cluster 1689212594.6666613 mgr.a (mgr.14152) 413 : cluster 0 pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:16 smithi154 bash[27744]: cluster 1689212595.551725 mon.a (mon.0) 642 : cluster 3 Health check update: 7 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:43:16.541 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:16 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:16.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:16 smithi137 bash[27262]: cluster 1689212594.6199918 mgr.a (mgr.14152) 411 : cluster 0 pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:16 smithi137 bash[27262]: cluster 1689212594.6663873 mgr.a (mgr.14152) 412 : cluster 0 pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:16 smithi137 bash[27262]: cluster 1689212594.6666613 mgr.a (mgr.14152) 413 : cluster 0 pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:16 smithi137 bash[27262]: cluster 1689212595.551725 mon.a (mon.0) 642 : cluster 3 Health check update: 7 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:43:16.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:16 smithi103 bash[27315]: cluster 1689212594.6199918 mgr.a (mgr.14152) 411 : cluster 0 pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:16 smithi103 bash[27315]: cluster 1689212594.6663873 mgr.a (mgr.14152) 412 : cluster 0 pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:16 smithi103 bash[27315]: cluster 1689212594.6666613 mgr.a (mgr.14152) 413 : cluster 0 pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:16 smithi103 bash[27315]: cluster 1689212595.551725 mon.a (mon.0) 642 : cluster 3 Health check update: 7 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:43:16.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:16 smithi022 bash[26979]: cluster 1689212594.6199918 mgr.a (mgr.14152) 411 : cluster 0 pgmap v316: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:16 smithi022 bash[26979]: cluster 1689212594.6663873 mgr.a (mgr.14152) 412 : cluster 0 pgmap v317: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:16 smithi022 bash[26979]: cluster 1689212594.6666613 mgr.a (mgr.14152) 413 : cluster 0 pgmap v318: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:16.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:16 smithi022 bash[26979]: cluster 1689212595.551725 mon.a (mon.0) 642 : cluster 3 Health check update: 7 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:43:18.145 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:17 smithi084 bash[46297]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:18.145 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:17 smithi084 bash[46297]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:18.145 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:17 smithi084 bash[46297]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:18.146 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:17 smithi084 bash[46297]: --> Failed to activate any OSD(s) 2023-07-13T01:43:18.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:18 smithi103 bash[27315]: cluster 1689212596.6671076 mgr.a (mgr.14152) 414 : cluster 0 pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:18.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:18 smithi154 bash[27744]: cluster 1689212596.6671076 mgr.a (mgr.14152) 414 : cluster 0 pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:18.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:18 smithi137 bash[27262]: cluster 1689212596.6671076 mgr.a (mgr.14152) 414 : cluster 0 pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:18.581 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 6 on host 'smithi103' 2023-07-13T01:43:18.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:18 smithi084 bash[27323]: cluster 1689212596.6671076 mgr.a (mgr.14152) 414 : cluster 0 pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:18.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:18 smithi022 bash[26979]: cluster 1689212596.6671076 mgr.a (mgr.14152) 414 : cluster 0 pgmap v319: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:19.294 DEBUG:teuthology.orchestra.run.smithi103:osd.6> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service 2023-07-13T01:43:19.297 INFO:tasks.cephadm:Deploying osd.7 on smithi103 with /dev/vg_nvme/lv_3... 2023-07-13T01:43:19.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-13T01:43:19.537 INFO:journalctl@ceph.osd.6.smithi103.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:43:19.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:19 smithi103 bash[27315]: audit 1689212598.5366406 mon.a (mon.0) 643 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:19 smithi103 bash[27315]: audit 1689212598.5434725 mon.a (mon.0) 644 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:19 smithi103 bash[27315]: audit 1689212598.5646954 mon.a (mon.0) 645 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:19.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:19 smithi103 bash[27315]: cluster 1689212598.6675196 mgr.a (mgr.14152) 415 : cluster 0 pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:19.794 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:19 smithi084 bash[27323]: audit 1689212598.5366406 mon.a (mon.0) 643 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.795 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:19 smithi084 bash[27323]: audit 1689212598.5434725 mon.a (mon.0) 644 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.795 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:19 smithi084 bash[27323]: audit 1689212598.5646954 mon.a (mon.0) 645 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:19.795 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:19 smithi084 bash[27323]: cluster 1689212598.6675196 mgr.a (mgr.14152) 415 : cluster 0 pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:19.806 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:19 smithi137 bash[27262]: audit 1689212598.5366406 mon.a (mon.0) 643 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:19 smithi137 bash[27262]: audit 1689212598.5434725 mon.a (mon.0) 644 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:19 smithi137 bash[27262]: audit 1689212598.5646954 mon.a (mon.0) 645 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:19.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:19 smithi137 bash[27262]: cluster 1689212598.6675196 mgr.a (mgr.14152) 415 : cluster 0 pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:19.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:19 smithi022 bash[26979]: audit 1689212598.5366406 mon.a (mon.0) 643 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:19 smithi022 bash[26979]: audit 1689212598.5434725 mon.a (mon.0) 644 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:19.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:19 smithi022 bash[26979]: audit 1689212598.5646954 mon.a (mon.0) 645 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:19.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:19 smithi022 bash[26979]: cluster 1689212598.6675196 mgr.a (mgr.14152) 415 : cluster 0 pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:20.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:19 smithi154 bash[27744]: audit 1689212598.5366406 mon.a (mon.0) 643 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:20.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:19 smithi154 bash[27744]: audit 1689212598.5434725 mon.a (mon.0) 644 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:20.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:19 smithi154 bash[27744]: audit 1689212598.5646954 mon.a (mon.0) 645 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:43:20.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:19 smithi154 bash[27744]: cluster 1689212598.6675196 mgr.a (mgr.14152) 415 : cluster 0 pgmap v320: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:20.160 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:19 smithi084 bash[46469]: debug 2023-07-13T01:43:19.796+0000 7fa1a4901700 1 -- 172.21.15.84:0/3734387961 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5562e270cd00 con 0x5562e2763000 2023-07-13T01:43:20.161 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:19 smithi084 bash[46469]: debug 2023-07-13T01:43:19.800+0000 7fa1ada86640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:21.391 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:21 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:43:21.391 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:21 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:21.645 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:21 smithi084 bash[46612]: debug 2023-07-13T01:43:21.456+0000 7f4151538700 1 -- 172.21.15.84:0/1953741079 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5588e6c34d00 con 0x5588e6c8b000 2023-07-13T01:43:21.645 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:21 smithi084 bash[46612]: debug 2023-07-13T01:43:21.460+0000 7f415a6bd640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:22.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:21 smithi154 bash[27744]: cluster 1689212600.667968 mgr.a (mgr.14152) 416 : cluster 0 pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:22.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:21 smithi137 bash[27262]: cluster 1689212600.667968 mgr.a (mgr.14152) 416 : cluster 0 pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:22.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:21 smithi103 bash[27315]: cluster 1689212600.667968 mgr.a (mgr.14152) 416 : cluster 0 pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:22.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:21 smithi084 bash[27323]: cluster 1689212600.667968 mgr.a (mgr.14152) 416 : cluster 0 pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:22.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:21 smithi022 bash[26979]: cluster 1689212600.667968 mgr.a (mgr.14152) 416 : cluster 0 pgmap v321: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:23.144 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:22 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:23.444 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.c/config 2023-07-13T01:43:23.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:23 smithi103 bash[27315]: cluster 1689212602.6684906 mgr.a (mgr.14152) 417 : cluster 0 pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:23.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:23 smithi084 bash[27323]: cluster 1689212602.6684906 mgr.a (mgr.14152) 417 : cluster 0 pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:24.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:23 smithi154 bash[27744]: cluster 1689212602.6684906 mgr.a (mgr.14152) 417 : cluster 0 pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:24.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:23 smithi137 bash[27262]: cluster 1689212602.6684906 mgr.a (mgr.14152) 417 : cluster 0 pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:24.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:23 smithi022 bash[26979]: cluster 1689212602.6684906 mgr.a (mgr.14152) 417 : cluster 0 pgmap v322: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:24.645 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:24 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2023-07-13T01:43:25.430 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:25 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:43:25.430 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:25 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:25.430 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:25 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:25.785 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:25 smithi103 bash[27315]: cluster 1689212604.6689656 mgr.a (mgr.14152) 418 : cluster 0 pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:25.895 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:25 smithi084 bash[27323]: cluster 1689212604.6689656 mgr.a (mgr.14152) 418 : cluster 0 pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:25.895 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:25 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:43:25.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:25 smithi022 bash[26979]: cluster 1689212604.6689656 mgr.a (mgr.14152) 418 : cluster 0 pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:26.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:25 smithi154 bash[27744]: cluster 1689212604.6689656 mgr.a (mgr.14152) 418 : cluster 0 pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:26.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:25 smithi137 bash[27262]: cluster 1689212604.6689656 mgr.a (mgr.14152) 418 : cluster 0 pgmap v323: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:27.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:27 smithi103 bash[27315]: cluster 1689212606.6694272 mgr.a (mgr.14152) 419 : cluster 0 pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:28.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:27 smithi154 bash[27744]: cluster 1689212606.6694272 mgr.a (mgr.14152) 419 : cluster 0 pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:28.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:27 smithi137 bash[27262]: cluster 1689212606.6694272 mgr.a (mgr.14152) 419 : cluster 0 pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:28.104 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:27 smithi103 bash[31590]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:28.105 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:27 smithi103 bash[31590]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:28.105 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:27 smithi103 bash[31590]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:28.105 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:27 smithi103 bash[31590]: --> Failed to activate any OSD(s) 2023-07-13T01:43:28.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:27 smithi084 bash[27323]: cluster 1689212606.6694272 mgr.a (mgr.14152) 419 : cluster 0 pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:28.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:27 smithi022 bash[26979]: cluster 1689212606.6694272 mgr.a (mgr.14152) 419 : cluster 0 pgmap v324: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:28.836 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-13T01:43:28.836 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-13T01:43:28.837 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2023-07-13T01:43:28.837 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2023-07-13T01:43:28.837 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132904 s, 789 MB/s 2023-07-13T01:43:28.837 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2023-07-13T01:43:30.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:29 smithi154 bash[27744]: cluster 1689212608.6699593 mgr.a (mgr.14152) 420 : cluster 0 pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:30.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:29 smithi137 bash[27262]: cluster 1689212608.6699593 mgr.a (mgr.14152) 420 : cluster 0 pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:30.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:29 smithi103 bash[27315]: cluster 1689212608.6699593 mgr.a (mgr.14152) 420 : cluster 0 pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:30.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:29 smithi084 bash[27323]: cluster 1689212608.6699593 mgr.a (mgr.14152) 420 : cluster 0 pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:30.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:29 smithi022 bash[26979]: cluster 1689212608.6699593 mgr.a (mgr.14152) 420 : cluster 0 pgmap v325: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:30.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2023-07-13T01:43:31.079 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:30 smithi103 bash[31977]: debug 2023-07-13T01:43:30.856+0000 7f9a51c08700 1 -- 172.21.15.103:0/605708857 <== mon.4 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 621+0+0 (secure 0 0 0) 0x565504623600 con 0x565504633000 2023-07-13T01:43:31.080 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:30 smithi103 bash[31977]: debug 2023-07-13T01:43:30.856+0000 7f9a51c08700 1 -- 172.21.15.103:0/605708857 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5655045dcd00 con 0x565504633000 2023-07-13T01:43:31.080 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:30 smithi103 bash[31977]: debug 2023-07-13T01:43:30.856+0000 7f9a5ad8d640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:31.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:31 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 11. 2023-07-13T01:43:31.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:31 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:31.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:31 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:31.854 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:31 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: cluster 1689212610.6704583 mgr.a (mgr.14152) 421 : cluster 0 pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: cephadm 1689212610.7308717 mgr.a (mgr.14152) 422 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.7446637 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.7521653 mon.a (mon.0) 647 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.753816 mon.a (mon.0) 648 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: cephadm 1689212610.7551074 mgr.a (mgr.14152) 423 : cephadm 1 Adjusting osd_memory_target on smithi103 to 17265M 2023-07-13T01:43:31.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.7619 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:31.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.7635396 mon.a (mon.0) 650 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:31.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.764858 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:31.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: cluster 1689212610.7676623 mgr.a (mgr.14152) 424 : cluster 0 pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:31.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: cluster 1689212610.767827 mgr.a (mgr.14152) 425 : cluster 0 pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:31.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:31 smithi103 bash[27315]: audit 1689212610.7740064 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: cluster 1689212610.6704583 mgr.a (mgr.14152) 421 : cluster 0 pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: cephadm 1689212610.7308717 mgr.a (mgr.14152) 422 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:43:32.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.7446637 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.7521653 mon.a (mon.0) 647 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.753816 mon.a (mon.0) 648 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:43:32.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: cephadm 1689212610.7551074 mgr.a (mgr.14152) 423 : cephadm 1 Adjusting osd_memory_target on smithi103 to 17265M 2023-07-13T01:43:32.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.7619 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.7635396 mon.a (mon.0) 650 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:32.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.764858 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:32.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: cluster 1689212610.7676623 mgr.a (mgr.14152) 424 : cluster 0 pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: cluster 1689212610.767827 mgr.a (mgr.14152) 425 : cluster 0 pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:31 smithi154 bash[27744]: audit 1689212610.7740064 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: cluster 1689212610.6704583 mgr.a (mgr.14152) 421 : cluster 0 pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: cephadm 1689212610.7308717 mgr.a (mgr.14152) 422 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:43:32.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.7446637 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.7521653 mon.a (mon.0) 647 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.753816 mon.a (mon.0) 648 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:43:32.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: cephadm 1689212610.7551074 mgr.a (mgr.14152) 423 : cephadm 1 Adjusting osd_memory_target on smithi103 to 17265M 2023-07-13T01:43:32.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.7619 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.7635396 mon.a (mon.0) 650 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:32.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.764858 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:32.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: cluster 1689212610.7676623 mgr.a (mgr.14152) 424 : cluster 0 pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: cluster 1689212610.767827 mgr.a (mgr.14152) 425 : cluster 0 pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.059 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:31 smithi137 bash[27262]: audit 1689212610.7740064 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: cluster 1689212610.6704583 mgr.a (mgr.14152) 421 : cluster 0 pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: cephadm 1689212610.7308717 mgr.a (mgr.14152) 422 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.7446637 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.7521653 mon.a (mon.0) 647 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.753816 mon.a (mon.0) 648 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: cephadm 1689212610.7551074 mgr.a (mgr.14152) 423 : cephadm 1 Adjusting osd_memory_target on smithi103 to 17265M 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.7619 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.7635396 mon.a (mon.0) 650 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:32.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.764858 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:32.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: cluster 1689212610.7676623 mgr.a (mgr.14152) 424 : cluster 0 pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: cluster 1689212610.767827 mgr.a (mgr.14152) 425 : cluster 0 pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:31 smithi084 bash[27323]: audit 1689212610.7740064 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: cluster 1689212610.6704583 mgr.a (mgr.14152) 421 : cluster 0 pgmap v326: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: cephadm 1689212610.7308717 mgr.a (mgr.14152) 422 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.7446637 mon.a (mon.0) 646 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.7521653 mon.a (mon.0) 647 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.753816 mon.a (mon.0) 648 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: cephadm 1689212610.7551074 mgr.a (mgr.14152) 423 : cephadm 1 Adjusting osd_memory_target on smithi103 to 17265M 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.7619 mon.a (mon.0) 649 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.7635396 mon.a (mon.0) 650 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:32.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.764858 mon.a (mon.0) 651 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:43:32.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: cluster 1689212610.7676623 mgr.a (mgr.14152) 424 : cluster 0 pgmap v327: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: cluster 1689212610.767827 mgr.a (mgr.14152) 425 : cluster 0 pgmap v328: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:32.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:31 smithi022 bash[26979]: audit 1689212610.7740064 mon.a (mon.0) 652 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:43:32.894 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:32 smithi084 bash[47137]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:32.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:32 smithi084 bash[47137]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:32.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:32 smithi084 bash[47137]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:32.895 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:32 smithi084 bash[47137]: --> Failed to activate any OSD(s) 2023-07-13T01:43:34.097 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:33 smithi084 bash[27323]: cluster 1689212612.7682877 mgr.a (mgr.14152) 426 : cluster 0 pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:34.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:33 smithi103 bash[27315]: cluster 1689212612.7682877 mgr.a (mgr.14152) 426 : cluster 0 pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:34.105 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:33 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:43:34.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:33 smithi022 bash[26979]: cluster 1689212612.7682877 mgr.a (mgr.14152) 426 : cluster 0 pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:34.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:33 smithi154 bash[27744]: cluster 1689212612.7682877 mgr.a (mgr.14152) 426 : cluster 0 pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:34.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:33 smithi137 bash[27262]: cluster 1689212612.7682877 mgr.a (mgr.14152) 426 : cluster 0 pgmap v329: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:34.347 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:34 smithi084 bash[47241]: debug 2023-07-13T01:43:34.224+0000 7feb204b1700 1 -- 172.21.15.84:0/107267352 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e56de04d00 con 0x55e56de5b000 2023-07-13T01:43:34.348 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:34 smithi084 bash[47241]: debug 2023-07-13T01:43:34.224+0000 7feb29636640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:34.348 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:34 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:43:34.348 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:34 smithi084 systemd[1]: Stopped Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:34.348 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:34 smithi084 systemd[1]: Started Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:35.214 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.c/config 2023-07-13T01:43:35.715 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:35 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:35.716 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:35 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:43:35.716 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:35 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:35.716 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:35 smithi084 systemd[1]: Started Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:35.717 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:35 smithi084 bash[27323]: cluster 1689212614.7687993 mgr.a (mgr.14152) 427 : cluster 0 pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:35.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:35 smithi103 bash[27315]: cluster 1689212614.7687993 mgr.a (mgr.14152) 427 : cluster 0 pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:35.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:35 smithi022 bash[26979]: cluster 1689212614.7687993 mgr.a (mgr.14152) 427 : cluster 0 pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:36.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:35 smithi154 bash[27744]: cluster 1689212614.7687993 mgr.a (mgr.14152) 427 : cluster 0 pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:36.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:35 smithi137 bash[27262]: cluster 1689212614.7687993 mgr.a (mgr.14152) 427 : cluster 0 pgmap v330: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:36.894 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:36 smithi084 bash[47353]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:36.895 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:36 smithi084 bash[47353]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:36.895 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:36 smithi084 bash[47353]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:36.895 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:36 smithi084 bash[47353]: --> Failed to activate any OSD(s) 2023-07-13T01:43:38.071 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:37 smithi084 bash[27323]: cluster 1689212616.7692828 mgr.a (mgr.14152) 428 : cluster 0 pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:38.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:37 smithi103 bash[27315]: cluster 1689212616.7692828 mgr.a (mgr.14152) 428 : cluster 0 pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:38.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:37 smithi022 bash[26979]: cluster 1689212616.7692828 mgr.a (mgr.14152) 428 : cluster 0 pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:38.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:37 smithi154 bash[27744]: cluster 1689212616.7692828 mgr.a (mgr.14152) 428 : cluster 0 pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:38.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:37 smithi137 bash[27262]: cluster 1689212616.7692828 mgr.a (mgr.14152) 428 : cluster 0 pgmap v331: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:39.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:38 smithi103 bash[27315]: audit 1689212618.308438 mon.a (mon.0) 653 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:43:39.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:38 smithi103 bash[27315]: audit 1689212618.313818 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:43:39.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:38 smithi103 bash[27315]: audit 1689212618.3152096 mon.a (mon.0) 655 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:39.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[27323]: audit 1689212618.308438 mon.a (mon.0) 653 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:43:39.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[27323]: audit 1689212618.313818 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:43:39.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[27323]: audit 1689212618.3152096 mon.a (mon.0) 655 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:39.145 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[47451]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:39.145 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[47451]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:39.146 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[47451]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:39.146 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:38 smithi084 bash[47451]: --> Failed to activate any OSD(s) 2023-07-13T01:43:39.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:38 smithi022 bash[26979]: audit 1689212618.308438 mon.a (mon.0) 653 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:43:39.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:38 smithi022 bash[26979]: audit 1689212618.313818 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:43:39.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:38 smithi022 bash[26979]: audit 1689212618.3152096 mon.a (mon.0) 655 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:39.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:38 smithi154 bash[27744]: audit 1689212618.308438 mon.a (mon.0) 653 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:43:39.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:38 smithi154 bash[27744]: audit 1689212618.313818 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:43:39.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:38 smithi154 bash[27744]: audit 1689212618.3152096 mon.a (mon.0) 655 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:39.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:38 smithi137 bash[27262]: audit 1689212618.308438 mon.a (mon.0) 653 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:43:39.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:38 smithi137 bash[27262]: audit 1689212618.313818 mon.a (mon.0) 654 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:43:39.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:38 smithi137 bash[27262]: audit 1689212618.3152096 mon.a (mon.0) 655 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:43:39.815 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:39 smithi084 bash[47558]: debug 2023-07-13T01:43:39.532+0000 7fb290e2f700 1 -- 172.21.15.84:0/1147650772 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556e50fdcd00 con 0x556e51033000 2023-07-13T01:43:39.816 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:39 smithi084 bash[47558]: debug 2023-07-13T01:43:39.536+0000 7fb299fb4640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:40.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:39 smithi103 bash[27315]: audit 1689212618.301596 mgr.a (mgr.14152) 429 : audit 0 from='client.24402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:43:40.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:39 smithi103 bash[27315]: cluster 1689212618.7697482 mgr.a (mgr.14152) 430 : cluster 0 pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:40.133 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:40 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:43:40.134 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:39 smithi084 bash[27323]: audit 1689212618.301596 mgr.a (mgr.14152) 429 : audit 0 from='client.24402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:43:40.134 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:39 smithi084 bash[27323]: cluster 1689212618.7697482 mgr.a (mgr.14152) 430 : cluster 0 pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:40.164 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:39 smithi022 bash[26979]: audit 1689212618.301596 mgr.a (mgr.14152) 429 : audit 0 from='client.24402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:43:40.165 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:39 smithi022 bash[26979]: cluster 1689212618.7697482 mgr.a (mgr.14152) 430 : cluster 0 pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:40.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:39 smithi154 bash[27744]: audit 1689212618.301596 mgr.a (mgr.14152) 429 : audit 0 from='client.24402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:43:40.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:39 smithi154 bash[27744]: cluster 1689212618.7697482 mgr.a (mgr.14152) 430 : cluster 0 pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:40.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:39 smithi137 bash[27262]: audit 1689212618.301596 mgr.a (mgr.14152) 429 : audit 0 from='client.24402 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:43:40.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:39 smithi137 bash[27262]: cluster 1689212618.7697482 mgr.a (mgr.14152) 430 : cluster 0 pgmap v332: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:41.397 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:41 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:42.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:41 smithi103 bash[27315]: cluster 1689212620.770231 mgr.a (mgr.14152) 431 : cluster 0 pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:42.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:41 smithi084 bash[27323]: cluster 1689212620.770231 mgr.a (mgr.14152) 431 : cluster 0 pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:42.144 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:42 smithi084 bash[47812]: debug 2023-07-13T01:43:42.020+0000 7fecb2560700 1 -- 172.21.15.84:0/3495804009 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563c84292d00 con 0x563c842e8c00 2023-07-13T01:43:42.145 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:42 smithi084 bash[47812]: debug 2023-07-13T01:43:42.020+0000 7fecbb6e5640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:42.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:41 smithi022 bash[26979]: cluster 1689212620.770231 mgr.a (mgr.14152) 431 : cluster 0 pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:42.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:41 smithi154 bash[27744]: cluster 1689212620.770231 mgr.a (mgr.14152) 431 : cluster 0 pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:42.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:41 smithi137 bash[27262]: cluster 1689212620.770231 mgr.a (mgr.14152) 431 : cluster 0 pgmap v333: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:43.144 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:42 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:44.104 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:43 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:43:44.104 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:43 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:44.104 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:43 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:44.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:43 smithi103 bash[27315]: cluster 1689212622.7707224 mgr.a (mgr.14152) 432 : cluster 0 pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:44.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:43 smithi084 bash[27323]: cluster 1689212622.7707224 mgr.a (mgr.14152) 432 : cluster 0 pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:44.145 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:44 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2023-07-13T01:43:44.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:43 smithi022 bash[26979]: cluster 1689212622.7707224 mgr.a (mgr.14152) 432 : cluster 0 pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:44.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:43 smithi154 bash[27744]: cluster 1689212622.7707224 mgr.a (mgr.14152) 432 : cluster 0 pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:44.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:43 smithi137 bash[27262]: cluster 1689212622.7707224 mgr.a (mgr.14152) 432 : cluster 0 pgmap v334: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:45.830 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:45 smithi103 bash[27315]: cluster 1689212624.771227 mgr.a (mgr.14152) 433 : cluster 0 pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:45.831 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:45 smithi103 bash[33041]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:45.831 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:45 smithi103 bash[33041]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:45.831 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:45 smithi103 bash[33041]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:45.831 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:45 smithi103 bash[33041]: --> Failed to activate any OSD(s) 2023-07-13T01:43:45.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:45 smithi084 bash[27323]: cluster 1689212624.771227 mgr.a (mgr.14152) 433 : cluster 0 pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:45.895 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:45 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:43:45.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:45 smithi022 bash[26979]: cluster 1689212624.771227 mgr.a (mgr.14152) 433 : cluster 0 pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:46.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:45 smithi154 bash[27744]: cluster 1689212624.771227 mgr.a (mgr.14152) 433 : cluster 0 pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:46.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:45 smithi137 bash[27262]: cluster 1689212624.771227 mgr.a (mgr.14152) 433 : cluster 0 pgmap v335: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:48.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:47 smithi103 bash[27315]: cluster 1689212626.771686 mgr.a (mgr.14152) 434 : cluster 0 pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:48.102 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:47 smithi103 bash[33237]: debug 2023-07-13T01:43:47.924+0000 7facd3f5c700 1 -- 172.21.15.103:0/65994381 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5616503d8d00 con 0x56165042ec00 2023-07-13T01:43:48.103 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:47 smithi103 bash[33237]: debug 2023-07-13T01:43:47.924+0000 7facdd0e1640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:48.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:47 smithi084 bash[27323]: cluster 1689212626.771686 mgr.a (mgr.14152) 434 : cluster 0 pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:48.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:47 smithi022 bash[26979]: cluster 1689212626.771686 mgr.a (mgr.14152) 434 : cluster 0 pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:48.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:47 smithi154 bash[27744]: cluster 1689212626.771686 mgr.a (mgr.14152) 434 : cluster 0 pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:48.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:47 smithi137 bash[27262]: cluster 1689212626.771686 mgr.a (mgr.14152) 434 : cluster 0 pgmap v336: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:49.104 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:48 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:49.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4395263 mon.a (mon.0) 656 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]: dispatch 2023-07-13T01:43:49.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4497352 mon.a (mon.0) 657 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]': finished 2023-07-13T01:43:49.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: cluster 1689212628.449963 mon.a (mon.0) 658 : cluster 0 osdmap e12: 8 total, 0 up, 8 in 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4503164 mon.a (mon.0) 659 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4511075 mon.a (mon.0) 660 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.451562 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4519615 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4523838 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.45279 mon.a (mon.0) 664 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:43:49.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4531834 mon.a (mon.0) 665 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:43:49.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:48 smithi103 bash[27315]: audit 1689212628.4535844 mon.a (mon.0) 666 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:43:49.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4395263 mon.a (mon.0) 656 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]: dispatch 2023-07-13T01:43:49.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4497352 mon.a (mon.0) 657 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]': finished 2023-07-13T01:43:49.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: cluster 1689212628.449963 mon.a (mon.0) 658 : cluster 0 osdmap e12: 8 total, 0 up, 8 in 2023-07-13T01:43:49.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4503164 mon.a (mon.0) 659 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:43:49.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4511075 mon.a (mon.0) 660 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:43:49.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.451562 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:43:49.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4519615 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:43:49.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4523838 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:43:49.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.45279 mon.a (mon.0) 664 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:43:49.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4531834 mon.a (mon.0) 665 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:43:49.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:48 smithi084 bash[27323]: audit 1689212628.4535844 mon.a (mon.0) 666 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:43:49.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4395263 mon.a (mon.0) 656 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]: dispatch 2023-07-13T01:43:49.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4497352 mon.a (mon.0) 657 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]': finished 2023-07-13T01:43:49.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: cluster 1689212628.449963 mon.a (mon.0) 658 : cluster 0 osdmap e12: 8 total, 0 up, 8 in 2023-07-13T01:43:49.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4503164 mon.a (mon.0) 659 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:43:49.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4511075 mon.a (mon.0) 660 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:43:49.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.451562 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:43:49.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4519615 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:43:49.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4523838 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:43:49.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.45279 mon.a (mon.0) 664 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:43:49.162 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4531834 mon.a (mon.0) 665 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:43:49.163 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:48 smithi022 bash[26979]: audit 1689212628.4535844 mon.a (mon.0) 666 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:43:49.259 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4395263 mon.a (mon.0) 656 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]: dispatch 2023-07-13T01:43:49.260 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4497352 mon.a (mon.0) 657 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]': finished 2023-07-13T01:43:49.260 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: cluster 1689212628.449963 mon.a (mon.0) 658 : cluster 0 osdmap e12: 8 total, 0 up, 8 in 2023-07-13T01:43:49.260 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4503164 mon.a (mon.0) 659 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:43:49.260 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4511075 mon.a (mon.0) 660 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:43:49.260 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.451562 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:43:49.260 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4519615 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:43:49.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4523838 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:43:49.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.45279 mon.a (mon.0) 664 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:43:49.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4531834 mon.a (mon.0) 665 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:43:49.261 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:48 smithi154 bash[27744]: audit 1689212628.4535844 mon.a (mon.0) 666 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:43:49.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4395263 mon.a (mon.0) 656 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]: dispatch 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4497352 mon.a (mon.0) 657 : audit 1 from='client.? 172.21.15.103:0/1235152910' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e0d9e33-7a94-4406-9926-bc0c3682eeba"}]': finished 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: cluster 1689212628.449963 mon.a (mon.0) 658 : cluster 0 osdmap e12: 8 total, 0 up, 8 in 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4503164 mon.a (mon.0) 659 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4511075 mon.a (mon.0) 660 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.451562 mon.a (mon.0) 661 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4519615 mon.a (mon.0) 662 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:43:49.307 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4523838 mon.a (mon.0) 663 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:43:49.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.45279 mon.a (mon.0) 664 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:43:49.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4531834 mon.a (mon.0) 665 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:43:49.308 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:48 smithi137 bash[27262]: audit 1689212628.4535844 mon.a (mon.0) 666 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:43:50.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:49 smithi103 bash[27315]: cluster 1689212628.7721758 mgr.a (mgr.14152) 435 : cluster 0 pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:50.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:49 smithi103 bash[27315]: audit 1689212629.1953743 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.103:0/393100728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:43:50.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:49 smithi084 bash[27323]: cluster 1689212628.7721758 mgr.a (mgr.14152) 435 : cluster 0 pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:50.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:49 smithi084 bash[27323]: audit 1689212629.1953743 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.103:0/393100728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:43:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:49 smithi022 bash[26979]: cluster 1689212628.7721758 mgr.a (mgr.14152) 435 : cluster 0 pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:49 smithi022 bash[26979]: audit 1689212629.1953743 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.103:0/393100728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:43:50.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:49 smithi154 bash[27744]: cluster 1689212628.7721758 mgr.a (mgr.14152) 435 : cluster 0 pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:50.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:49 smithi154 bash[27744]: audit 1689212629.1953743 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.103:0/393100728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:43:50.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:49 smithi137 bash[27262]: cluster 1689212628.7721758 mgr.a (mgr.14152) 435 : cluster 0 pgmap v338: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:50.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:49 smithi137 bash[27262]: audit 1689212629.1953743 mon.c (mon.2) 5 : audit 0 from='client.? 172.21.15.103:0/393100728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:43:50.644 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:50 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 12. 2023-07-13T01:43:50.644 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:50 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:50.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:50 smithi084 systemd[1]: Started Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:51.354 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:43:50 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:43:51.644 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:51 smithi084 bash[48212]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:51.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:51 smithi084 bash[48212]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:43:51.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:51 smithi084 bash[48212]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:43:51.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:51 smithi084 bash[48212]: --> Failed to activate any OSD(s) 2023-07-13T01:43:52.079 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:51 smithi084 bash[27323]: cluster 1689212630.772635 mgr.a (mgr.14152) 436 : cluster 0 pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:52.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:51 smithi103 bash[27315]: cluster 1689212630.772635 mgr.a (mgr.14152) 436 : cluster 0 pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:51 smithi022 bash[26979]: cluster 1689212630.772635 mgr.a (mgr.14152) 436 : cluster 0 pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:52.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:51 smithi154 bash[27744]: cluster 1689212630.772635 mgr.a (mgr.14152) 436 : cluster 0 pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:52.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:51 smithi137 bash[27262]: cluster 1689212630.772635 mgr.a (mgr.14152) 436 : cluster 0 pgmap v339: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:53.223 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:53 smithi084 bash[48316]: debug 2023-07-13T01:43:53.064+0000 7f7750f6f700 1 -- 172.21.15.84:0/716950815 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55925241ad00 con 0x559252470c00 2023-07-13T01:43:53.223 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:53 smithi084 bash[48316]: debug 2023-07-13T01:43:53.064+0000 7f775a0f4640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:43:54.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:53 smithi103 bash[27315]: cluster 1689212632.7730823 mgr.a (mgr.14152) 437 : cluster 0 pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:54.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:53 smithi084 bash[27323]: cluster 1689212632.7730823 mgr.a (mgr.14152) 437 : cluster 0 pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:54.144 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:53 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:43:54.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:53 smithi022 bash[26979]: cluster 1689212632.7730823 mgr.a (mgr.14152) 437 : cluster 0 pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:54.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:53 smithi154 bash[27744]: cluster 1689212632.7730823 mgr.a (mgr.14152) 437 : cluster 0 pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:54.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:53 smithi137 bash[27262]: cluster 1689212632.7730823 mgr.a (mgr.14152) 437 : cluster 0 pgmap v340: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:54.644 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:54 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:43:54.645 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:54 smithi084 systemd[1]: Stopped Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:54.645 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:54 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Start request repeated too quickly. 2023-07-13T01:43:54.645 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:54 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service: Failed with result 'exit-code'. 2023-07-13T01:43:54.645 INFO:journalctl@ceph.osd.5.smithi084.stdout:Jul 13 01:43:54 smithi084 systemd[1]: Failed to start Ceph osd.5 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:55.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:55 smithi103 bash[27315]: cluster 1689212634.773553 mgr.a (mgr.14152) 438 : cluster 0 pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:55.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:55 smithi084 bash[27323]: cluster 1689212634.773553 mgr.a (mgr.14152) 438 : cluster 0 pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:55.895 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:55 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:43:55.895 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:55 smithi084 systemd[1]: Stopped Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:55.895 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:55 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Start request repeated too quickly. 2023-07-13T01:43:55.896 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:55 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service: Failed with result 'exit-code'. 2023-07-13T01:43:55.896 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jul 13 01:43:55 smithi084 systemd[1]: Failed to start Ceph osd.4 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:43:55.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:55 smithi022 bash[26979]: cluster 1689212634.773553 mgr.a (mgr.14152) 438 : cluster 0 pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:56.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:55 smithi154 bash[27744]: cluster 1689212634.773553 mgr.a (mgr.14152) 438 : cluster 0 pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:56.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:55 smithi137 bash[27262]: cluster 1689212634.773553 mgr.a (mgr.14152) 438 : cluster 0 pgmap v341: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:56.394 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:43:55 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:43:58.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:57 smithi103 bash[27315]: cluster 1689212636.774019 mgr.a (mgr.14152) 439 : cluster 0 pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:58.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:57 smithi084 bash[27323]: cluster 1689212636.774019 mgr.a (mgr.14152) 439 : cluster 0 pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:58.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:57 smithi022 bash[26979]: cluster 1689212636.774019 mgr.a (mgr.14152) 439 : cluster 0 pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:58.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:57 smithi154 bash[27744]: cluster 1689212636.774019 mgr.a (mgr.14152) 439 : cluster 0 pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:43:58.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:57 smithi137 bash[27262]: cluster 1689212636.774019 mgr.a (mgr.14152) 439 : cluster 0 pgmap v342: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:00.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:43:59 smithi103 bash[27315]: cluster 1689212638.7744951 mgr.a (mgr.14152) 440 : cluster 0 pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:00.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:43:59 smithi084 bash[27323]: cluster 1689212638.7744951 mgr.a (mgr.14152) 440 : cluster 0 pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:00.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:43:59 smithi022 bash[26979]: cluster 1689212638.7744951 mgr.a (mgr.14152) 440 : cluster 0 pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:00.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:43:59 smithi154 bash[27744]: cluster 1689212638.7744951 mgr.a (mgr.14152) 440 : cluster 0 pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:00.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:43:59 smithi137 bash[27262]: cluster 1689212638.7744951 mgr.a (mgr.14152) 440 : cluster 0 pgmap v343: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:01.505 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:01 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:44:01.505 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:01 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:01.505 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:01 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:02.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:01 smithi103 bash[27315]: cluster 1689212640.7749758 mgr.a (mgr.14152) 441 : cluster 0 pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:02.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:01 smithi103 bash[27315]: audit 1689212641.1600196 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-13T01:44:02.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:01 smithi103 bash[27315]: audit 1689212641.1618385 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:02.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:01 smithi103 bash[27315]: cephadm 1689212641.1634598 mgr.a (mgr.14152) 442 : cephadm 1 Deploying daemon osd.7 on smithi103 2023-07-13T01:44:02.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:01 smithi084 bash[27323]: cluster 1689212640.7749758 mgr.a (mgr.14152) 441 : cluster 0 pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:02.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:01 smithi084 bash[27323]: audit 1689212641.1600196 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-13T01:44:02.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:01 smithi084 bash[27323]: audit 1689212641.1618385 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:02.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:01 smithi084 bash[27323]: cephadm 1689212641.1634598 mgr.a (mgr.14152) 442 : cephadm 1 Deploying daemon osd.7 on smithi103 2023-07-13T01:44:02.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:01 smithi022 bash[26979]: cluster 1689212640.7749758 mgr.a (mgr.14152) 441 : cluster 0 pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:02.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:01 smithi022 bash[26979]: audit 1689212641.1600196 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-13T01:44:02.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:01 smithi022 bash[26979]: audit 1689212641.1618385 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:02.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:01 smithi022 bash[26979]: cephadm 1689212641.1634598 mgr.a (mgr.14152) 442 : cephadm 1 Deploying daemon osd.7 on smithi103 2023-07-13T01:44:02.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:01 smithi154 bash[27744]: cluster 1689212640.7749758 mgr.a (mgr.14152) 441 : cluster 0 pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:02.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:01 smithi154 bash[27744]: audit 1689212641.1600196 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-13T01:44:02.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:01 smithi154 bash[27744]: audit 1689212641.1618385 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:02.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:01 smithi154 bash[27744]: cephadm 1689212641.1634598 mgr.a (mgr.14152) 442 : cephadm 1 Deploying daemon osd.7 on smithi103 2023-07-13T01:44:02.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:01 smithi137 bash[27262]: cluster 1689212640.7749758 mgr.a (mgr.14152) 441 : cluster 0 pgmap v344: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:02.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:01 smithi137 bash[27262]: audit 1689212641.1600196 mon.a (mon.0) 667 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-13T01:44:02.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:01 smithi137 bash[27262]: audit 1689212641.1618385 mon.a (mon.0) 668 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:02.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:01 smithi137 bash[27262]: cephadm 1689212641.1634598 mgr.a (mgr.14152) 442 : cephadm 1 Deploying daemon osd.7 on smithi103 2023-07-13T01:44:03.354 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:03 smithi103 bash[34776]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:03.355 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:03 smithi103 bash[34776]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:03.355 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:03 smithi103 bash[34776]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:44:03.355 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:03 smithi103 bash[34776]: --> Failed to activate any OSD(s) 2023-07-13T01:44:04.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:03 smithi103 bash[27315]: cluster 1689212642.7754424 mgr.a (mgr.14152) 443 : cluster 0 pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:04.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:03 smithi084 bash[27323]: cluster 1689212642.7754424 mgr.a (mgr.14152) 443 : cluster 0 pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:04.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:03 smithi022 bash[26979]: cluster 1689212642.7754424 mgr.a (mgr.14152) 443 : cluster 0 pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:04.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:03 smithi154 bash[27744]: cluster 1689212642.7754424 mgr.a (mgr.14152) 443 : cluster 0 pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:04.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:03 smithi137 bash[27262]: cluster 1689212642.7754424 mgr.a (mgr.14152) 443 : cluster 0 pgmap v345: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:05.849 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:05 smithi103 bash[27315]: cluster 1689212644.775934 mgr.a (mgr.14152) 444 : cluster 0 pgmap v346: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:05.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:05 smithi103 bash[35007]: debug 2023-07-13T01:44:05.772+0000 7f4e4663b700 1 -- 172.21.15.103:0/273504551 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e41e094d00 con 0x55e41e0eac00 2023-07-13T01:44:05.853 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:05 smithi103 bash[35007]: debug 2023-07-13T01:44:05.772+0000 7f4e4f7c0640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:44:05.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:05 smithi084 bash[27323]: cluster 1689212644.775934 mgr.a (mgr.14152) 444 : cluster 0 pgmap v346: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:05.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:05 smithi022 bash[26979]: cluster 1689212644.775934 mgr.a (mgr.14152) 444 : cluster 0 pgmap v346: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:06.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:05 smithi154 bash[27744]: cluster 1689212644.775934 mgr.a (mgr.14152) 444 : cluster 0 pgmap v346: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:06.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:05 smithi137 bash[27262]: cluster 1689212644.775934 mgr.a (mgr.14152) 444 : cluster 0 pgmap v346: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:06.644 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:44:06 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Scheduled restart job, restart counter is at 13. 2023-07-13T01:44:06.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:44:06 smithi084 systemd[1]: Stopped Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:06.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:44:06 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Start request repeated too quickly. 2023-07-13T01:44:06.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:44:06 smithi084 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service: Failed with result 'exit-code'. 2023-07-13T01:44:06.645 INFO:journalctl@ceph.osd.3.smithi084.stdout:Jul 13 01:44:06 smithi084 systemd[1]: Failed to start Ceph osd.3 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:07.103 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:06 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:44:07.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:07 smithi103 bash[27315]: cluster 1689212646.7764196 mgr.a (mgr.14152) 445 : cluster 0 pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:07.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:07 smithi103 bash[27315]: audit 1689212647.6438859 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:07.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:07 smithi103 bash[27315]: audit 1689212647.6510096 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:07.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:07 smithi103 bash[27315]: audit 1689212647.6592183 mon.a (mon.0) 671 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:08.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:07 smithi084 bash[27323]: cluster 1689212646.7764196 mgr.a (mgr.14152) 445 : cluster 0 pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:08.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:07 smithi084 bash[27323]: audit 1689212647.6438859 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:07 smithi084 bash[27323]: audit 1689212647.6510096 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:07 smithi084 bash[27323]: audit 1689212647.6592183 mon.a (mon.0) 671 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:08.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:07 smithi022 bash[26979]: cluster 1689212646.7764196 mgr.a (mgr.14152) 445 : cluster 0 pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:08.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:07 smithi022 bash[26979]: audit 1689212647.6438859 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:07 smithi022 bash[26979]: audit 1689212647.6510096 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:07 smithi022 bash[26979]: audit 1689212647.6592183 mon.a (mon.0) 671 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:08.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:07 smithi154 bash[27744]: cluster 1689212646.7764196 mgr.a (mgr.14152) 445 : cluster 0 pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:08.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:07 smithi154 bash[27744]: audit 1689212647.6438859 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:07 smithi154 bash[27744]: audit 1689212647.6510096 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.257 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:07 smithi154 bash[27744]: audit 1689212647.6592183 mon.a (mon.0) 671 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:08.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:07 smithi137 bash[27262]: cluster 1689212646.7764196 mgr.a (mgr.14152) 445 : cluster 0 pgmap v347: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:08.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:07 smithi137 bash[27262]: audit 1689212647.6438859 mon.a (mon.0) 669 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:07 smithi137 bash[27262]: audit 1689212647.6510096 mon.a (mon.0) 670 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:08.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:07 smithi137 bash[27262]: audit 1689212647.6592183 mon.a (mon.0) 671 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:09.223 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:09 smithi103 bash[27315]: audit 1689212648.0364861 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.223 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:09 smithi103 bash[27315]: audit 1689212648.0441043 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:09 smithi137 bash[27262]: audit 1689212648.0364861 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:09 smithi137 bash[27262]: audit 1689212648.0441043 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:09 smithi084 bash[27323]: audit 1689212648.0364861 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:09 smithi084 bash[27323]: audit 1689212648.0441043 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:09 smithi022 bash[26979]: audit 1689212648.0364861 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:09 smithi022 bash[26979]: audit 1689212648.0441043 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:09 smithi154 bash[27744]: audit 1689212648.0364861 mon.a (mon.0) 672 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:09.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:09 smithi154 bash[27744]: audit 1689212648.0441043 mon.a (mon.0) 673 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:10.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:10 smithi137 bash[27262]: cluster 1689212648.7768745 mgr.a (mgr.14152) 446 : cluster 0 pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:10.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:10 smithi103 bash[27315]: cluster 1689212648.7768745 mgr.a (mgr.14152) 446 : cluster 0 pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:10.354 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:10 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:44:10.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:10 smithi084 bash[27323]: cluster 1689212648.7768745 mgr.a (mgr.14152) 446 : cluster 0 pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:10.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:10 smithi022 bash[26979]: cluster 1689212648.7768745 mgr.a (mgr.14152) 446 : cluster 0 pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:10.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:10 smithi154 bash[27744]: cluster 1689212648.7768745 mgr.a (mgr.14152) 446 : cluster 0 pgmap v348: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:12.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:12 smithi137 bash[27262]: cluster 1689212650.7773674 mgr.a (mgr.14152) 447 : cluster 0 pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:12.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:12 smithi103 bash[27315]: cluster 1689212650.7773674 mgr.a (mgr.14152) 447 : cluster 0 pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:12.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:12 smithi084 bash[27323]: cluster 1689212650.7773674 mgr.a (mgr.14152) 447 : cluster 0 pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:12.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:12 smithi022 bash[26979]: cluster 1689212650.7773674 mgr.a (mgr.14152) 447 : cluster 0 pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:12.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:12 smithi154 bash[27744]: cluster 1689212650.7773674 mgr.a (mgr.14152) 447 : cluster 0 pgmap v349: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:14.190 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:14 smithi103 bash[27315]: cluster 1689212652.777841 mgr.a (mgr.14152) 448 : cluster 0 pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:14.191 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:14 smithi103 bash[27315]: audit 1689212653.3033934 mon.a (mon.0) 674 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.191 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:14 smithi103 bash[27315]: audit 1689212653.3110905 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.191 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:14 smithi103 bash[27315]: audit 1689212653.3124137 mon.a (mon.0) 676 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:14.191 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:14 smithi103 bash[27315]: audit 1689212653.3137143 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:14.191 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:14 smithi103 bash[27315]: audit 1689212653.323292 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:14 smithi137 bash[27262]: cluster 1689212652.777841 mgr.a (mgr.14152) 448 : cluster 0 pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:14.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:14 smithi137 bash[27262]: audit 1689212653.3033934 mon.a (mon.0) 674 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:14 smithi137 bash[27262]: audit 1689212653.3110905 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:14 smithi137 bash[27262]: audit 1689212653.3124137 mon.a (mon.0) 676 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:14.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:14 smithi137 bash[27262]: audit 1689212653.3137143 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:14.306 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:14 smithi137 bash[27262]: audit 1689212653.323292 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:14 smithi084 bash[27323]: cluster 1689212652.777841 mgr.a (mgr.14152) 448 : cluster 0 pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:14.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:14 smithi084 bash[27323]: audit 1689212653.3033934 mon.a (mon.0) 674 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:14 smithi084 bash[27323]: audit 1689212653.3110905 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:14 smithi084 bash[27323]: audit 1689212653.3124137 mon.a (mon.0) 676 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:14.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:14 smithi084 bash[27323]: audit 1689212653.3137143 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:14.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:14 smithi084 bash[27323]: audit 1689212653.323292 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:14 smithi022 bash[26979]: cluster 1689212652.777841 mgr.a (mgr.14152) 448 : cluster 0 pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:14 smithi022 bash[26979]: audit 1689212653.3033934 mon.a (mon.0) 674 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:14 smithi022 bash[26979]: audit 1689212653.3110905 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:14 smithi022 bash[26979]: audit 1689212653.3124137 mon.a (mon.0) 676 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:14 smithi022 bash[26979]: audit 1689212653.3137143 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:14.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:14 smithi022 bash[26979]: audit 1689212653.323292 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:14 smithi154 bash[27744]: cluster 1689212652.777841 mgr.a (mgr.14152) 448 : cluster 0 pgmap v350: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:14.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:14 smithi154 bash[27744]: audit 1689212653.3033934 mon.a (mon.0) 674 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:14 smithi154 bash[27744]: audit 1689212653.3110905 mon.a (mon.0) 675 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:14.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:14 smithi154 bash[27744]: audit 1689212653.3124137 mon.a (mon.0) 676 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:14.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:14 smithi154 bash[27744]: audit 1689212653.3137143 mon.a (mon.0) 677 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:14.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:14 smithi154 bash[27744]: audit 1689212653.323292 mon.a (mon.0) 678 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:15.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:15 smithi137 bash[27262]: cluster 1689212653.3166273 mgr.a (mgr.14152) 449 : cluster 0 pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:15 smithi137 bash[27262]: cluster 1689212653.3169515 mgr.a (mgr.14152) 450 : cluster 0 pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:15 smithi137 bash[27262]: cluster 1689212654.3076296 mon.a (mon.0) 679 : cluster 3 Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:44:15.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:15 smithi103 bash[27315]: cluster 1689212653.3166273 mgr.a (mgr.14152) 449 : cluster 0 pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:15 smithi103 bash[27315]: cluster 1689212653.3169515 mgr.a (mgr.14152) 450 : cluster 0 pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:15 smithi103 bash[27315]: cluster 1689212654.3076296 mon.a (mon.0) 679 : cluster 3 Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:44:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:15 smithi084 bash[27323]: cluster 1689212653.3166273 mgr.a (mgr.14152) 449 : cluster 0 pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:15 smithi084 bash[27323]: cluster 1689212653.3169515 mgr.a (mgr.14152) 450 : cluster 0 pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:15 smithi084 bash[27323]: cluster 1689212654.3076296 mon.a (mon.0) 679 : cluster 3 Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:44:15.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:15 smithi022 bash[26979]: cluster 1689212653.3166273 mgr.a (mgr.14152) 449 : cluster 0 pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:15 smithi022 bash[26979]: cluster 1689212653.3169515 mgr.a (mgr.14152) 450 : cluster 0 pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:15 smithi022 bash[26979]: cluster 1689212654.3076296 mon.a (mon.0) 679 : cluster 3 Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:44:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:15 smithi154 bash[27744]: cluster 1689212653.3166273 mgr.a (mgr.14152) 449 : cluster 0 pgmap v351: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:15 smithi154 bash[27744]: cluster 1689212653.3169515 mgr.a (mgr.14152) 450 : cluster 0 pgmap v352: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:15.507 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:15 smithi154 bash[27744]: cluster 1689212654.3076296 mon.a (mon.0) 679 : cluster 3 Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:44:17.305 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:17 smithi137 bash[27262]: cluster 1689212655.3174124 mgr.a (mgr.14152) 451 : cluster 0 pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:17.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:17 smithi103 bash[27315]: cluster 1689212655.3174124 mgr.a (mgr.14152) 451 : cluster 0 pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:17.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:17 smithi084 bash[27323]: cluster 1689212655.3174124 mgr.a (mgr.14152) 451 : cluster 0 pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:17.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:17 smithi022 bash[26979]: cluster 1689212655.3174124 mgr.a (mgr.14152) 451 : cluster 0 pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:17.483 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 7 on host 'smithi103' 2023-07-13T01:44:17.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:17 smithi154 bash[27744]: cluster 1689212655.3174124 mgr.a (mgr.14152) 451 : cluster 0 pgmap v353: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:18.195 DEBUG:teuthology.orchestra.run.smithi103:osd.7> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service 2023-07-13T01:44:18.197 INFO:tasks.cephadm:Deploying osd.8 on smithi103 with /dev/vg_nvme/lv_2... 2023-07-13T01:44:18.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-13T01:44:18.379 INFO:journalctl@ceph.osd.7.smithi103.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:44:18.756 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:18 smithi154 bash[27744]: cluster 1689212657.317889 mgr.a (mgr.14152) 452 : cluster 0 pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:18.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:18 smithi154 bash[27744]: audit 1689212657.4630804 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:18 smithi154 bash[27744]: audit 1689212657.470101 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:18 smithi154 bash[27744]: audit 1689212657.4704328 mon.a (mon.0) 682 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:18.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:18 smithi137 bash[27262]: cluster 1689212657.317889 mgr.a (mgr.14152) 452 : cluster 0 pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:18.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:18 smithi137 bash[27262]: audit 1689212657.4630804 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:18 smithi137 bash[27262]: audit 1689212657.470101 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.806 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:18 smithi137 bash[27262]: audit 1689212657.4704328 mon.a (mon.0) 682 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:18.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:18 smithi103 bash[27315]: cluster 1689212657.317889 mgr.a (mgr.14152) 452 : cluster 0 pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:18.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:18 smithi103 bash[27315]: audit 1689212657.4630804 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:18 smithi103 bash[27315]: audit 1689212657.470101 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:18 smithi103 bash[27315]: audit 1689212657.4704328 mon.a (mon.0) 682 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:18.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:18 smithi084 bash[27323]: cluster 1689212657.317889 mgr.a (mgr.14152) 452 : cluster 0 pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:18.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:18 smithi084 bash[27323]: audit 1689212657.4630804 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:18 smithi084 bash[27323]: audit 1689212657.470101 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:18 smithi084 bash[27323]: audit 1689212657.4704328 mon.a (mon.0) 682 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:18.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:18 smithi022 bash[26979]: cluster 1689212657.317889 mgr.a (mgr.14152) 452 : cluster 0 pgmap v354: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:18.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:18 smithi022 bash[26979]: audit 1689212657.4630804 mon.a (mon.0) 680 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:18 smithi022 bash[26979]: audit 1689212657.470101 mon.a (mon.0) 681 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:18.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:18 smithi022 bash[26979]: audit 1689212657.4704328 mon.a (mon.0) 682 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:44:20.582 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:20 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:44:20.582 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:20 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:20.582 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:20 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:20.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:20 smithi103 bash[27315]: cluster 1689212659.3183522 mgr.a (mgr.14152) 453 : cluster 0 pgmap v355: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:20.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:20 smithi084 bash[27323]: cluster 1689212659.3183522 mgr.a (mgr.14152) 453 : cluster 0 pgmap v355: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:20.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:20 smithi022 bash[26979]: cluster 1689212659.3183522 mgr.a (mgr.14152) 453 : cluster 0 pgmap v355: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:20 smithi154 bash[27744]: cluster 1689212659.3183522 mgr.a (mgr.14152) 453 : cluster 0 pgmap v355: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:21.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:20 smithi137 bash[27262]: cluster 1689212659.3183522 mgr.a (mgr.14152) 453 : cluster 0 pgmap v355: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:21.853 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:21 smithi103 bash[36294]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:21.854 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:21 smithi103 bash[36294]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:21.854 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:21 smithi103 bash[36294]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:44:21.854 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:21 smithi103 bash[36294]: --> Failed to activate any OSD(s) 2023-07-13T01:44:22.812 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.c/config 2023-07-13T01:44:22.840 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:22 smithi103 bash[27315]: cluster 1689212661.3188374 mgr.a (mgr.14152) 454 : cluster 0 pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:22.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:22 smithi084 bash[27323]: cluster 1689212661.3188374 mgr.a (mgr.14152) 454 : cluster 0 pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:22.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:22 smithi022 bash[26979]: cluster 1689212661.3188374 mgr.a (mgr.14152) 454 : cluster 0 pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:23.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:22 smithi154 bash[27744]: cluster 1689212661.3188374 mgr.a (mgr.14152) 454 : cluster 0 pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:23.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:22 smithi137 bash[27262]: cluster 1689212661.3188374 mgr.a (mgr.14152) 454 : cluster 0 pgmap v356: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:23.853 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:23 smithi103 bash[36436]: debug 2023-07-13T01:44:23.531+0000 7fe92b42e700 1 -- 172.21.15.103:0/221458216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581d6ae0d00 con 0x5581d6b36c00 2023-07-13T01:44:23.853 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:23 smithi103 bash[36436]: debug 2023-07-13T01:44:23.531+0000 7fe9345b3640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:44:24.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:24 smithi103 bash[27315]: cluster 1689212663.3193438 mgr.a (mgr.14152) 455 : cluster 0 pgmap v357: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:24.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:24 smithi084 bash[27323]: cluster 1689212663.3193438 mgr.a (mgr.14152) 455 : cluster 0 pgmap v357: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:24.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:24 smithi022 bash[26979]: cluster 1689212663.3193438 mgr.a (mgr.14152) 455 : cluster 0 pgmap v357: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:25.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:24 smithi154 bash[27744]: cluster 1689212663.3193438 mgr.a (mgr.14152) 455 : cluster 0 pgmap v357: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:25.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:24 smithi137 bash[27262]: cluster 1689212663.3193438 mgr.a (mgr.14152) 455 : cluster 0 pgmap v357: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:25.280 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:25 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:44:25.280 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:25 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:44:25.280 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:25 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:25.281 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:25 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:26.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:26 smithi084 bash[27323]: cluster 1689212665.3197777 mgr.a (mgr.14152) 456 : cluster 0 pgmap v358: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:26.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:26 smithi022 bash[26979]: cluster 1689212665.3197777 mgr.a (mgr.14152) 456 : cluster 0 pgmap v358: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:26.953 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:26 smithi103 bash[27315]: cluster 1689212665.3197777 mgr.a (mgr.14152) 456 : cluster 0 pgmap v358: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:27.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:26 smithi154 bash[27744]: cluster 1689212665.3197777 mgr.a (mgr.14152) 456 : cluster 0 pgmap v358: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:27.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:26 smithi137 bash[27262]: cluster 1689212665.3197777 mgr.a (mgr.14152) 456 : cluster 0 pgmap v358: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:28.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:28 smithi103 bash[36732]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:28.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:28 smithi103 bash[36732]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:28.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:28 smithi103 bash[36732]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:44:28.854 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:28 smithi103 bash[36732]: --> Failed to activate any OSD(s) 2023-07-13T01:44:28.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:28 smithi103 bash[27315]: cluster 1689212667.3203359 mgr.a (mgr.14152) 457 : cluster 0 pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:28.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:28 smithi084 bash[27323]: cluster 1689212667.3203359 mgr.a (mgr.14152) 457 : cluster 0 pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:28.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:28 smithi022 bash[26979]: cluster 1689212667.3203359 mgr.a (mgr.14152) 457 : cluster 0 pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:29.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:28 smithi154 bash[27744]: cluster 1689212667.3203359 mgr.a (mgr.14152) 457 : cluster 0 pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:29.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:28 smithi137 bash[27262]: cluster 1689212667.3203359 mgr.a (mgr.14152) 457 : cluster 0 pgmap v359: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:30.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:30 smithi084 bash[27323]: cluster 1689212669.3208923 mgr.a (mgr.14152) 458 : cluster 0 pgmap v360: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:30.894 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:30 smithi103 bash[27315]: cluster 1689212669.3208923 mgr.a (mgr.14152) 458 : cluster 0 pgmap v360: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:30.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:30 smithi022 bash[26979]: cluster 1689212669.3208923 mgr.a (mgr.14152) 458 : cluster 0 pgmap v360: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:31.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:30 smithi154 bash[27744]: cluster 1689212669.3208923 mgr.a (mgr.14152) 458 : cluster 0 pgmap v360: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:31.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:30 smithi137 bash[27262]: cluster 1689212669.3208923 mgr.a (mgr.14152) 458 : cluster 0 pgmap v360: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:31.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:31 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:44:31.762 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-13T01:44:31.762 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-13T01:44:31.762 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2023-07-13T01:44:31.762 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2023-07-13T01:44:31.763 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0200758 s, 522 MB/s 2023-07-13T01:44:31.763 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2023-07-13T01:44:31.823 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:31 smithi103 bash[36981]: debug 2023-07-13T01:44:31.659+0000 7f8eb6850700 1 -- 172.21.15.103:0/1510708138 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56444f4d6d00 con 0x56444f52c800 2023-07-13T01:44:31.823 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:31 smithi103 bash[36981]: debug 2023-07-13T01:44:31.659+0000 7f8ebf9d5640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:44:32.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:32 smithi084 bash[27323]: cluster 1689212671.321376 mgr.a (mgr.14152) 459 : cluster 0 pgmap v361: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:32.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:32 smithi022 bash[26979]: cluster 1689212671.321376 mgr.a (mgr.14152) 459 : cluster 0 pgmap v361: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:33.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:32 smithi154 bash[27744]: cluster 1689212671.321376 mgr.a (mgr.14152) 459 : cluster 0 pgmap v361: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:33.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:32 smithi137 bash[27262]: cluster 1689212671.321376 mgr.a (mgr.14152) 459 : cluster 0 pgmap v361: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:33.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:32 smithi103 bash[27315]: cluster 1689212671.321376 mgr.a (mgr.14152) 459 : cluster 0 pgmap v361: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:33.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2023-07-13T01:44:33.603 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:33 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:44:34.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: cluster 1689212673.3218446 mgr.a (mgr.14152) 460 : cluster 0 pgmap v362: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: cephadm 1689212673.6547906 mgr.a (mgr.14152) 461 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:44:34.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.6630619 mon.a (mon.0) 683 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.658 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.6706996 mon.a (mon.0) 684 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.658 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.6720812 mon.a (mon.0) 685 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:34.658 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.6732335 mon.a (mon.0) 686 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:34.658 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: cephadm 1689212673.6740663 mgr.a (mgr.14152) 462 : cephadm 1 Adjusting osd_memory_target on smithi103 to 8632M 2023-07-13T01:44:34.658 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.680386 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.659 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.6820076 mon.a (mon.0) 688 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:34.659 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.6834707 mon.a (mon.0) 689 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:34.659 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: cluster 1689212673.6863773 mgr.a (mgr.14152) 463 : cluster 0 pgmap v363: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: cluster 1689212673.3218446 mgr.a (mgr.14152) 460 : cluster 0 pgmap v362: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: cephadm 1689212673.6547906 mgr.a (mgr.14152) 461 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:44:34.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.6630619 mon.a (mon.0) 683 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.6706996 mon.a (mon.0) 684 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.6720812 mon.a (mon.0) 685 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:34.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.6732335 mon.a (mon.0) 686 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:34.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: cephadm 1689212673.6740663 mgr.a (mgr.14152) 462 : cephadm 1 Adjusting osd_memory_target on smithi103 to 8632M 2023-07-13T01:44:34.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.680386 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.6820076 mon.a (mon.0) 688 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:34.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.6834707 mon.a (mon.0) 689 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:34.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: cluster 1689212673.6863773 mgr.a (mgr.14152) 463 : cluster 0 pgmap v363: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: cluster 1689212673.6865504 mgr.a (mgr.14152) 464 : cluster 0 pgmap v364: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:34 smithi022 bash[26979]: audit 1689212673.692345 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: cluster 1689212673.3218446 mgr.a (mgr.14152) 460 : cluster 0 pgmap v362: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.945 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: cephadm 1689212673.6547906 mgr.a (mgr.14152) 461 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:44:34.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.6630619 mon.a (mon.0) 683 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.6706996 mon.a (mon.0) 684 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.6720812 mon.a (mon.0) 685 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:34.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.6732335 mon.a (mon.0) 686 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:34.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: cephadm 1689212673.6740663 mgr.a (mgr.14152) 462 : cephadm 1 Adjusting osd_memory_target on smithi103 to 8632M 2023-07-13T01:44:34.946 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.680386 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:34.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.6820076 mon.a (mon.0) 688 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:34.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.6834707 mon.a (mon.0) 689 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:34.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: cluster 1689212673.6863773 mgr.a (mgr.14152) 463 : cluster 0 pgmap v363: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: cluster 1689212673.6865504 mgr.a (mgr.14152) 464 : cluster 0 pgmap v364: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:34.947 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:34 smithi103 bash[27315]: audit 1689212673.692345 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: cluster 1689212673.3218446 mgr.a (mgr.14152) 460 : cluster 0 pgmap v362: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: cephadm 1689212673.6547906 mgr.a (mgr.14152) 461 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:44:35.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.6630619 mon.a (mon.0) 683 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.6706996 mon.a (mon.0) 684 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.6720812 mon.a (mon.0) 685 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:35.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.6732335 mon.a (mon.0) 686 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:35.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: cephadm 1689212673.6740663 mgr.a (mgr.14152) 462 : cephadm 1 Adjusting osd_memory_target on smithi103 to 8632M 2023-07-13T01:44:35.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.680386 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.6820076 mon.a (mon.0) 688 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:35.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.6834707 mon.a (mon.0) 689 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:35.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: cluster 1689212673.6863773 mgr.a (mgr.14152) 463 : cluster 0 pgmap v363: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: cluster 1689212673.6865504 mgr.a (mgr.14152) 464 : cluster 0 pgmap v364: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:34 smithi154 bash[27744]: audit 1689212673.692345 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: cluster 1689212673.3218446 mgr.a (mgr.14152) 460 : cluster 0 pgmap v362: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: cephadm 1689212673.6547906 mgr.a (mgr.14152) 461 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:44:35.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.6630619 mon.a (mon.0) 683 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.6706996 mon.a (mon.0) 684 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.6720812 mon.a (mon.0) 685 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.6732335 mon.a (mon.0) 686 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: cephadm 1689212673.6740663 mgr.a (mgr.14152) 462 : cephadm 1 Adjusting osd_memory_target on smithi103 to 8632M 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.680386 mon.a (mon.0) 687 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.6820076 mon.a (mon.0) 688 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:35.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.6834707 mon.a (mon.0) 689 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:44:35.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: cluster 1689212673.6863773 mgr.a (mgr.14152) 463 : cluster 0 pgmap v363: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: cluster 1689212673.6865504 mgr.a (mgr.14152) 464 : cluster 0 pgmap v364: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:34 smithi137 bash[27262]: audit 1689212673.692345 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: cluster 1689212673.6865504 mgr.a (mgr.14152) 464 : cluster 0 pgmap v364: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:35.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:34 smithi084 bash[27323]: audit 1689212673.692345 mon.a (mon.0) 690 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:44:35.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:35 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:44:37.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:36 smithi154 bash[27744]: cluster 1689212675.686987 mgr.a (mgr.14152) 465 : cluster 0 pgmap v365: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:37.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:36 smithi137 bash[27262]: cluster 1689212675.686987 mgr.a (mgr.14152) 465 : cluster 0 pgmap v365: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:37.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:36 smithi103 bash[27315]: cluster 1689212675.686987 mgr.a (mgr.14152) 465 : cluster 0 pgmap v365: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:37.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:36 smithi084 bash[27323]: cluster 1689212675.686987 mgr.a (mgr.14152) 465 : cluster 0 pgmap v365: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:37.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:36 smithi022 bash[26979]: cluster 1689212675.686987 mgr.a (mgr.14152) 465 : cluster 0 pgmap v365: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:37.969 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.c/config 2023-07-13T01:44:39.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:38 smithi154 bash[27744]: cluster 1689212677.6874251 mgr.a (mgr.14152) 466 : cluster 0 pgmap v366: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:39.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:38 smithi137 bash[27262]: cluster 1689212677.6874251 mgr.a (mgr.14152) 466 : cluster 0 pgmap v366: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:39.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:38 smithi103 bash[27315]: cluster 1689212677.6874251 mgr.a (mgr.14152) 466 : cluster 0 pgmap v366: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:39.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:38 smithi084 bash[27323]: cluster 1689212677.6874251 mgr.a (mgr.14152) 466 : cluster 0 pgmap v366: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:39.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:38 smithi022 bash[26979]: cluster 1689212677.6874251 mgr.a (mgr.14152) 466 : cluster 0 pgmap v366: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:40.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:40 smithi103 bash[27315]: cluster 1689212679.687915 mgr.a (mgr.14152) 467 : cluster 0 pgmap v367: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:40 smithi084 bash[27323]: cluster 1689212679.687915 mgr.a (mgr.14152) 467 : cluster 0 pgmap v367: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:40 smithi022 bash[26979]: cluster 1689212679.687915 mgr.a (mgr.14152) 467 : cluster 0 pgmap v367: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:41.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:40 smithi154 bash[27744]: cluster 1689212679.687915 mgr.a (mgr.14152) 467 : cluster 0 pgmap v367: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:41.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:40 smithi137 bash[27262]: cluster 1689212679.687915 mgr.a (mgr.14152) 467 : cluster 0 pgmap v367: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:41.601 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:41 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:44:41.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:41 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:41.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:41 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:41.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:41 smithi103 bash[27315]: audit 1689212681.2074208 mgr.a (mgr.14152) 468 : audit 0 from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:44:41.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:41 smithi103 bash[27315]: audit 1689212681.2145474 mon.a (mon.0) 691 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:44:41.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:41 smithi103 bash[27315]: audit 1689212681.21827 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:44:41.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:41 smithi103 bash[27315]: audit 1689212681.2196364 mon.a (mon.0) 693 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:41.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:41 smithi084 bash[27323]: audit 1689212681.2074208 mgr.a (mgr.14152) 468 : audit 0 from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:44:41.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:41 smithi084 bash[27323]: audit 1689212681.2145474 mon.a (mon.0) 691 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:44:41.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:41 smithi084 bash[27323]: audit 1689212681.21827 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:44:41.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:41 smithi084 bash[27323]: audit 1689212681.2196364 mon.a (mon.0) 693 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:41.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:41 smithi022 bash[26979]: audit 1689212681.2074208 mgr.a (mgr.14152) 468 : audit 0 from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:44:41.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:41 smithi022 bash[26979]: audit 1689212681.2145474 mon.a (mon.0) 691 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:44:41.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:41 smithi022 bash[26979]: audit 1689212681.21827 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:44:41.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:41 smithi022 bash[26979]: audit 1689212681.2196364 mon.a (mon.0) 693 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:42.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:41 smithi154 bash[27744]: audit 1689212681.2074208 mgr.a (mgr.14152) 468 : audit 0 from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:44:42.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:41 smithi154 bash[27744]: audit 1689212681.2145474 mon.a (mon.0) 691 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:44:42.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:41 smithi154 bash[27744]: audit 1689212681.21827 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:44:42.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:41 smithi154 bash[27744]: audit 1689212681.2196364 mon.a (mon.0) 693 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:42.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:41 smithi137 bash[27262]: audit 1689212681.2074208 mgr.a (mgr.14152) 468 : audit 0 from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:44:42.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:41 smithi137 bash[27262]: audit 1689212681.2145474 mon.a (mon.0) 691 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:44:42.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:41 smithi137 bash[27262]: audit 1689212681.21827 mon.a (mon.0) 692 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:44:42.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:41 smithi137 bash[27262]: audit 1689212681.2196364 mon.a (mon.0) 693 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:44:42.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:42 smithi103 bash[27315]: cluster 1689212681.6884184 mgr.a (mgr.14152) 469 : cluster 0 pgmap v368: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:42.853 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:42 smithi103 bash[38356]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:42.853 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:42 smithi103 bash[38356]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:42.854 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:42 smithi103 bash[38356]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:44:42.854 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:42 smithi103 bash[38356]: --> Failed to activate any OSD(s) 2023-07-13T01:44:42.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:42 smithi084 bash[27323]: cluster 1689212681.6884184 mgr.a (mgr.14152) 469 : cluster 0 pgmap v368: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:42.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:42 smithi022 bash[26979]: cluster 1689212681.6884184 mgr.a (mgr.14152) 469 : cluster 0 pgmap v368: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:43.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:42 smithi154 bash[27744]: cluster 1689212681.6884184 mgr.a (mgr.14152) 469 : cluster 0 pgmap v368: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:43.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:42 smithi137 bash[27262]: cluster 1689212681.6884184 mgr.a (mgr.14152) 469 : cluster 0 pgmap v368: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:44.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:44 smithi103 bash[38485]: debug 2023-07-13T01:44:44.175+0000 7fdfebb84700 1 -- 172.21.15.103:0/1539161725 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d2bbe86d00 con 0x55d2bbedc800 2023-07-13T01:44:44.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:44 smithi103 bash[38485]: debug 2023-07-13T01:44:44.175+0000 7fdff4d09640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:44:45.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:44 smithi154 bash[27744]: cluster 1689212683.6889117 mgr.a (mgr.14152) 470 : cluster 0 pgmap v369: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:45.041 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:44 smithi103 bash[27315]: cluster 1689212683.6889117 mgr.a (mgr.14152) 470 : cluster 0 pgmap v369: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:45.041 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:44 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:44:45.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:44 smithi137 bash[27262]: cluster 1689212683.6889117 mgr.a (mgr.14152) 470 : cluster 0 pgmap v369: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:45.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:44 smithi084 bash[27323]: cluster 1689212683.6889117 mgr.a (mgr.14152) 470 : cluster 0 pgmap v369: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:45.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:44 smithi022 bash[26979]: cluster 1689212683.6889117 mgr.a (mgr.14152) 470 : cluster 0 pgmap v369: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:45.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:45 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:44:45.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:45 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:45.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:45 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:47.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:46 smithi154 bash[27744]: cluster 1689212685.6894321 mgr.a (mgr.14152) 471 : cluster 0 pgmap v370: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:47.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:46 smithi137 bash[27262]: cluster 1689212685.6894321 mgr.a (mgr.14152) 471 : cluster 0 pgmap v370: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:47.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:46 smithi103 bash[27315]: cluster 1689212685.6894321 mgr.a (mgr.14152) 471 : cluster 0 pgmap v370: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:47.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:46 smithi084 bash[27323]: cluster 1689212685.6894321 mgr.a (mgr.14152) 471 : cluster 0 pgmap v370: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:47.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:46 smithi022 bash[26979]: cluster 1689212685.6894321 mgr.a (mgr.14152) 471 : cluster 0 pgmap v370: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:48.286 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:48 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:44:48.555 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:48 smithi103 bash[38689]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:48.555 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:48 smithi103 bash[38689]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:44:48.556 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:48 smithi103 bash[38689]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:44:48.556 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:48 smithi103 bash[38689]: --> Failed to activate any OSD(s) 2023-07-13T01:44:48.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:48 smithi103 bash[27315]: cluster 1689212687.6899254 mgr.a (mgr.14152) 472 : cluster 0 pgmap v371: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:49.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:48 smithi154 bash[27744]: cluster 1689212687.6899254 mgr.a (mgr.14152) 472 : cluster 0 pgmap v371: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:49.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:48 smithi137 bash[27262]: cluster 1689212687.6899254 mgr.a (mgr.14152) 472 : cluster 0 pgmap v371: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:49.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:48 smithi084 bash[27323]: cluster 1689212687.6899254 mgr.a (mgr.14152) 472 : cluster 0 pgmap v371: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:49.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:48 smithi022 bash[26979]: cluster 1689212687.6899254 mgr.a (mgr.14152) 472 : cluster 0 pgmap v371: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:50.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:50 smithi084 bash[27323]: cluster 1689212689.690462 mgr.a (mgr.14152) 473 : cluster 0 pgmap v372: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:50.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:50 smithi022 bash[26979]: cluster 1689212689.690462 mgr.a (mgr.14152) 473 : cluster 0 pgmap v372: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:50.912 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:50 smithi103 bash[27315]: cluster 1689212689.690462 mgr.a (mgr.14152) 473 : cluster 0 pgmap v372: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:51.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:50 smithi154 bash[27744]: cluster 1689212689.690462 mgr.a (mgr.14152) 473 : cluster 0 pgmap v372: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:51.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:50 smithi137 bash[27262]: cluster 1689212689.690462 mgr.a (mgr.14152) 473 : cluster 0 pgmap v372: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:51.291 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:51 smithi103 bash[38948]: debug 2023-07-13T01:44:51.067+0000 7fd0ac86b700 1 -- 172.21.15.103:0/468407218 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f2238cd00 con 0x558f223e2c00 2023-07-13T01:44:51.292 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:51 smithi103 bash[38948]: debug 2023-07-13T01:44:51.071+0000 7fd0b59f0640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:44:52.104 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:51 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:44:53.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: cluster 1689212691.6909988 mgr.a (mgr.14152) 474 : cluster 0 pgmap v373: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:53.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0321236 mon.a (mon.0) 694 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0341773 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.103:0/2712314428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0417469 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]': finished 2023-07-13T01:44:53.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: cluster 1689212692.0418794 mon.a (mon.0) 696 : cluster 0 osdmap e13: 9 total, 0 up, 9 in 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0420825 mon.a (mon.0) 697 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0427148 mon.a (mon.0) 698 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0430734 mon.a (mon.0) 699 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0434303 mon.a (mon.0) 700 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.043775 mon.a (mon.0) 701 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0440955 mon.a (mon.0) 702 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:44:53.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0443854 mon.a (mon.0) 703 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:44:53.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0446815 mon.a (mon.0) 704 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:44:53.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:52 smithi154 bash[27744]: audit 1689212692.0449817 mon.a (mon.0) 705 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:44:53.020 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: cluster 1689212691.6909988 mgr.a (mgr.14152) 474 : cluster 0 pgmap v373: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:53.020 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0321236 mon.a (mon.0) 694 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.020 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0341773 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.103:0/2712314428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.020 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0417469 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]': finished 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: cluster 1689212692.0418794 mon.a (mon.0) 696 : cluster 0 osdmap e13: 9 total, 0 up, 9 in 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0420825 mon.a (mon.0) 697 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0427148 mon.a (mon.0) 698 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0430734 mon.a (mon.0) 699 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0434303 mon.a (mon.0) 700 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.043775 mon.a (mon.0) 701 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0440955 mon.a (mon.0) 702 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:44:53.021 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0443854 mon.a (mon.0) 703 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:44:53.022 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0446815 mon.a (mon.0) 704 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:44:53.022 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:52 smithi103 bash[27315]: audit 1689212692.0449817 mon.a (mon.0) 705 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:44:53.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: cluster 1689212691.6909988 mgr.a (mgr.14152) 474 : cluster 0 pgmap v373: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:53.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0321236 mon.a (mon.0) 694 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0341773 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.103:0/2712314428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0417469 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]': finished 2023-07-13T01:44:53.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: cluster 1689212692.0418794 mon.a (mon.0) 696 : cluster 0 osdmap e13: 9 total, 0 up, 9 in 2023-07-13T01:44:53.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0420825 mon.a (mon.0) 697 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:44:53.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0427148 mon.a (mon.0) 698 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:44:53.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0430734 mon.a (mon.0) 699 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:44:53.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0434303 mon.a (mon.0) 700 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:44:53.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.043775 mon.a (mon.0) 701 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:44:53.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0440955 mon.a (mon.0) 702 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:44:53.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0443854 mon.a (mon.0) 703 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:44:53.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0446815 mon.a (mon.0) 704 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:44:53.058 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:52 smithi137 bash[27262]: audit 1689212692.0449817 mon.a (mon.0) 705 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:44:53.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: cluster 1689212691.6909988 mgr.a (mgr.14152) 474 : cluster 0 pgmap v373: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:53.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0321236 mon.a (mon.0) 694 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0341773 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.103:0/2712314428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0417469 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]': finished 2023-07-13T01:44:53.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: cluster 1689212692.0418794 mon.a (mon.0) 696 : cluster 0 osdmap e13: 9 total, 0 up, 9 in 2023-07-13T01:44:53.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0420825 mon.a (mon.0) 697 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0427148 mon.a (mon.0) 698 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0430734 mon.a (mon.0) 699 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0434303 mon.a (mon.0) 700 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.043775 mon.a (mon.0) 701 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0440955 mon.a (mon.0) 702 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0443854 mon.a (mon.0) 703 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0446815 mon.a (mon.0) 704 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:44:53.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:52 smithi084 bash[27323]: audit 1689212692.0449817 mon.a (mon.0) 705 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:44:53.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: cluster 1689212691.6909988 mgr.a (mgr.14152) 474 : cluster 0 pgmap v373: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0321236 mon.a (mon.0) 694 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0341773 mon.c (mon.2) 6 : audit 1 from='client.? 172.21.15.103:0/2712314428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]: dispatch 2023-07-13T01:44:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0417469 mon.a (mon.0) 695 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "867c2c13-e59e-4b45-8e10-93bdd46a336f"}]': finished 2023-07-13T01:44:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: cluster 1689212692.0418794 mon.a (mon.0) 696 : cluster 0 osdmap e13: 9 total, 0 up, 9 in 2023-07-13T01:44:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0420825 mon.a (mon.0) 697 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:44:53.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0427148 mon.a (mon.0) 698 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0430734 mon.a (mon.0) 699 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0434303 mon.a (mon.0) 700 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.043775 mon.a (mon.0) 701 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0440955 mon.a (mon.0) 702 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0443854 mon.a (mon.0) 703 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0446815 mon.a (mon.0) 704 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:44:53.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:52 smithi022 bash[26979]: audit 1689212692.0449817 mon.a (mon.0) 705 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:44:54.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:53 smithi154 bash[27744]: audit 1689212692.9775848 mon.b (mon.4) 19 : audit 0 from='client.? 172.21.15.103:0/4059220442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:44:54.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:53 smithi137 bash[27262]: audit 1689212692.9775848 mon.b (mon.4) 19 : audit 0 from='client.? 172.21.15.103:0/4059220442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:44:54.088 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:53 smithi103 bash[27315]: audit 1689212692.9775848 mon.b (mon.4) 19 : audit 0 from='client.? 172.21.15.103:0/4059220442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:44:54.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:53 smithi084 bash[27323]: audit 1689212692.9775848 mon.b (mon.4) 19 : audit 0 from='client.? 172.21.15.103:0/4059220442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:44:54.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:53 smithi022 bash[26979]: audit 1689212692.9775848 mon.b (mon.4) 19 : audit 0 from='client.? 172.21.15.103:0/4059220442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:44:54.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:44:54 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:44:55.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:54 smithi154 bash[27744]: cluster 1689212693.6914954 mgr.a (mgr.14152) 475 : cluster 0 pgmap v375: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:55.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:54 smithi137 bash[27262]: cluster 1689212693.6914954 mgr.a (mgr.14152) 475 : cluster 0 pgmap v375: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:55.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:54 smithi103 bash[27315]: cluster 1689212693.6914954 mgr.a (mgr.14152) 475 : cluster 0 pgmap v375: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:54 smithi084 bash[27323]: cluster 1689212693.6914954 mgr.a (mgr.14152) 475 : cluster 0 pgmap v375: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:55.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:54 smithi022 bash[26979]: cluster 1689212693.6914954 mgr.a (mgr.14152) 475 : cluster 0 pgmap v375: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:57.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:56 smithi137 bash[27262]: cluster 1689212695.6919892 mgr.a (mgr.14152) 476 : cluster 0 pgmap v376: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:57.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:56 smithi103 bash[27315]: cluster 1689212695.6919892 mgr.a (mgr.14152) 476 : cluster 0 pgmap v376: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:57.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:56 smithi084 bash[27323]: cluster 1689212695.6919892 mgr.a (mgr.14152) 476 : cluster 0 pgmap v376: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:57.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:56 smithi022 bash[26979]: cluster 1689212695.6919892 mgr.a (mgr.14152) 476 : cluster 0 pgmap v376: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:57.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:56 smithi154 bash[27744]: cluster 1689212695.6919892 mgr.a (mgr.14152) 476 : cluster 0 pgmap v376: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:58.759 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:58 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:44:58.760 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:58 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:58.760 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:58 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:44:59.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:44:58 smithi137 bash[27262]: cluster 1689212697.692467 mgr.a (mgr.14152) 477 : cluster 0 pgmap v377: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:59.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:44:58 smithi103 bash[27315]: cluster 1689212697.692467 mgr.a (mgr.14152) 477 : cluster 0 pgmap v377: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:59.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:44:58 smithi084 bash[27323]: cluster 1689212697.692467 mgr.a (mgr.14152) 477 : cluster 0 pgmap v377: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:59.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:44:58 smithi022 bash[26979]: cluster 1689212697.692467 mgr.a (mgr.14152) 477 : cluster 0 pgmap v377: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:44:59.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:44:58 smithi154 bash[27744]: cluster 1689212697.692467 mgr.a (mgr.14152) 477 : cluster 0 pgmap v377: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:00.102 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:59 smithi103 bash[40308]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:00.103 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:59 smithi103 bash[40308]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:00.103 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:59 smithi103 bash[40308]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:00.103 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:44:59 smithi103 bash[40308]: --> Failed to activate any OSD(s) 2023-07-13T01:45:00.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:00 smithi103 bash[27315]: cluster 1689212699.6929543 mgr.a (mgr.14152) 478 : cluster 0 pgmap v378: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:00.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:00 smithi084 bash[27323]: cluster 1689212699.6929543 mgr.a (mgr.14152) 478 : cluster 0 pgmap v378: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:00.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:00 smithi022 bash[26979]: cluster 1689212699.6929543 mgr.a (mgr.14152) 478 : cluster 0 pgmap v378: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:01.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:00 smithi154 bash[27744]: cluster 1689212699.6929543 mgr.a (mgr.14152) 478 : cluster 0 pgmap v378: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:01.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:00 smithi137 bash[27262]: cluster 1689212699.6929543 mgr.a (mgr.14152) 478 : cluster 0 pgmap v378: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:02.211 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:02 smithi103 bash[40430]: debug 2023-07-13T01:45:02.090+0000 7fa1316f4700 1 -- 172.21.15.103:0/1526346721 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556b413b6d00 con 0x556b4140c800 2023-07-13T01:45:02.212 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:02 smithi103 bash[40430]: debug 2023-07-13T01:45:02.090+0000 7fa13a879640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:02.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:02 smithi103 bash[27315]: cluster 1689212701.6934521 mgr.a (mgr.14152) 479 : cluster 0 pgmap v379: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:03.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:02 smithi154 bash[27744]: cluster 1689212701.6934521 mgr.a (mgr.14152) 479 : cluster 0 pgmap v379: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:03.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:02 smithi137 bash[27262]: cluster 1689212701.6934521 mgr.a (mgr.14152) 479 : cluster 0 pgmap v379: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:03.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:02 smithi084 bash[27323]: cluster 1689212701.6934521 mgr.a (mgr.14152) 479 : cluster 0 pgmap v379: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:03.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:02 smithi022 bash[26979]: cluster 1689212701.6934521 mgr.a (mgr.14152) 479 : cluster 0 pgmap v379: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:03.574 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:03 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:04.602 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:04 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:45:04.603 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:04 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:04.603 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:04 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:05.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:04 smithi154 bash[27744]: cluster 1689212703.6939442 mgr.a (mgr.14152) 480 : cluster 0 pgmap v380: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:05.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:04 smithi137 bash[27262]: cluster 1689212703.6939442 mgr.a (mgr.14152) 480 : cluster 0 pgmap v380: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:05.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:04 smithi103 bash[27315]: cluster 1689212703.6939442 mgr.a (mgr.14152) 480 : cluster 0 pgmap v380: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:05.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:04 smithi084 bash[27323]: cluster 1689212703.6939442 mgr.a (mgr.14152) 480 : cluster 0 pgmap v380: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:05.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:04 smithi022 bash[26979]: cluster 1689212703.6939442 mgr.a (mgr.14152) 480 : cluster 0 pgmap v380: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:06.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:06 smithi103 bash[40707]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:06.353 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:06 smithi103 bash[40707]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:06.353 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:06 smithi103 bash[40707]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:06.353 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:06 smithi103 bash[40707]: --> Failed to activate any OSD(s) 2023-07-13T01:45:07.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:06 smithi154 bash[27744]: cluster 1689212705.694429 mgr.a (mgr.14152) 481 : cluster 0 pgmap v381: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:07.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:06 smithi137 bash[27262]: cluster 1689212705.694429 mgr.a (mgr.14152) 481 : cluster 0 pgmap v381: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:07.119 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:06 smithi103 bash[27315]: cluster 1689212705.694429 mgr.a (mgr.14152) 481 : cluster 0 pgmap v381: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:07.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:06 smithi084 bash[27323]: cluster 1689212705.694429 mgr.a (mgr.14152) 481 : cluster 0 pgmap v381: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:07.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:06 smithi022 bash[26979]: cluster 1689212705.694429 mgr.a (mgr.14152) 481 : cluster 0 pgmap v381: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:08.008 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:07 smithi103 bash[27315]: audit 1689212707.4945078 mon.a (mon.0) 706 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-13T01:45:08.008 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:07 smithi103 bash[27315]: audit 1689212707.4962811 mon.a (mon.0) 707 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:08.008 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:07 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:45:08.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:07 smithi137 bash[27262]: audit 1689212707.4945078 mon.a (mon.0) 706 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-13T01:45:08.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:07 smithi137 bash[27262]: audit 1689212707.4962811 mon.a (mon.0) 707 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:08.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:07 smithi084 bash[27323]: audit 1689212707.4945078 mon.a (mon.0) 706 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-13T01:45:08.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:07 smithi084 bash[27323]: audit 1689212707.4962811 mon.a (mon.0) 707 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:08.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:07 smithi022 bash[26979]: audit 1689212707.4945078 mon.a (mon.0) 706 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-13T01:45:08.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:07 smithi022 bash[26979]: audit 1689212707.4962811 mon.a (mon.0) 707 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:08.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:07 smithi154 bash[27744]: audit 1689212707.4945078 mon.a (mon.0) 706 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-13T01:45:08.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:07 smithi154 bash[27744]: audit 1689212707.4962811 mon.a (mon.0) 707 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:09.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:08 smithi137 bash[27262]: cephadm 1689212707.4976797 mgr.a (mgr.14152) 482 : cephadm 1 Deploying daemon osd.8 on smithi103 2023-07-13T01:45:09.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:08 smithi137 bash[27262]: cluster 1689212707.6949246 mgr.a (mgr.14152) 483 : cluster 0 pgmap v382: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:09.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:08 smithi103 bash[27315]: cephadm 1689212707.4976797 mgr.a (mgr.14152) 482 : cephadm 1 Deploying daemon osd.8 on smithi103 2023-07-13T01:45:09.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:08 smithi103 bash[27315]: cluster 1689212707.6949246 mgr.a (mgr.14152) 483 : cluster 0 pgmap v382: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:09.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:08 smithi084 bash[27323]: cephadm 1689212707.4976797 mgr.a (mgr.14152) 482 : cephadm 1 Deploying daemon osd.8 on smithi103 2023-07-13T01:45:09.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:08 smithi084 bash[27323]: cluster 1689212707.6949246 mgr.a (mgr.14152) 483 : cluster 0 pgmap v382: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:09.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:08 smithi022 bash[26979]: cephadm 1689212707.4976797 mgr.a (mgr.14152) 482 : cephadm 1 Deploying daemon osd.8 on smithi103 2023-07-13T01:45:09.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:08 smithi022 bash[26979]: cluster 1689212707.6949246 mgr.a (mgr.14152) 483 : cluster 0 pgmap v382: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:09.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:08 smithi154 bash[27744]: cephadm 1689212707.4976797 mgr.a (mgr.14152) 482 : cephadm 1 Deploying daemon osd.8 on smithi103 2023-07-13T01:45:09.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:08 smithi154 bash[27744]: cluster 1689212707.6949246 mgr.a (mgr.14152) 483 : cluster 0 pgmap v382: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:09.790 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:09 smithi103 bash[40974]: debug 2023-07-13T01:45:09.482+0000 7fcff381c700 1 -- 172.21.15.103:0/2351073820 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5575b362cd00 con 0x5575b3682800 2023-07-13T01:45:09.790 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:09 smithi103 bash[40974]: debug 2023-07-13T01:45:09.482+0000 7fcffc9a1640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:10.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:10 smithi103 bash[27315]: cluster 1689212709.6953545 mgr.a (mgr.14152) 484 : cluster 0 pgmap v383: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:10.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:10 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:10.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:10 smithi084 bash[27323]: cluster 1689212709.6953545 mgr.a (mgr.14152) 484 : cluster 0 pgmap v383: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:10.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:10 smithi022 bash[26979]: cluster 1689212709.6953545 mgr.a (mgr.14152) 484 : cluster 0 pgmap v383: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:11.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:10 smithi154 bash[27744]: cluster 1689212709.6953545 mgr.a (mgr.14152) 484 : cluster 0 pgmap v383: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:11.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:10 smithi137 bash[27262]: cluster 1689212709.6953545 mgr.a (mgr.14152) 484 : cluster 0 pgmap v383: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:13.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:12 smithi154 bash[27744]: cluster 1689212711.6958334 mgr.a (mgr.14152) 485 : cluster 0 pgmap v384: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:13.043 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:12 smithi103 bash[27315]: cluster 1689212711.6958334 mgr.a (mgr.14152) 485 : cluster 0 pgmap v384: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:13.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:12 smithi137 bash[27262]: cluster 1689212711.6958334 mgr.a (mgr.14152) 485 : cluster 0 pgmap v384: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:13.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:12 smithi084 bash[27323]: cluster 1689212711.6958334 mgr.a (mgr.14152) 485 : cluster 0 pgmap v384: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:13.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:12 smithi022 bash[26979]: cluster 1689212711.6958334 mgr.a (mgr.14152) 485 : cluster 0 pgmap v384: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:13.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:13 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:45:15.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: cluster 1689212713.6962998 mgr.a (mgr.14152) 486 : cluster 0 pgmap v385: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:15.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.1294045 mon.a (mon.0) 708 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.1370354 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.1375082 mon.a (mon.0) 710 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:15.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.5664244 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.5720184 mon.a (mon.0) 712 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.5768118 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.355 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.5819435 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.355 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.586878 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.355 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:15 smithi103 bash[27315]: audit 1689212714.5929697 mon.a (mon.0) 716 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: cluster 1689212713.6962998 mgr.a (mgr.14152) 486 : cluster 0 pgmap v385: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:15.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.1294045 mon.a (mon.0) 708 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.1370354 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.1375082 mon.a (mon.0) 710 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:15.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.5664244 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.5720184 mon.a (mon.0) 712 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.5768118 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.5819435 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.586878 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:15 smithi084 bash[27323]: audit 1689212714.5929697 mon.a (mon.0) 716 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: cluster 1689212713.6962998 mgr.a (mgr.14152) 486 : cluster 0 pgmap v385: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:15.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.1294045 mon.a (mon.0) 708 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.1370354 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.1375082 mon.a (mon.0) 710 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.5664244 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.5720184 mon.a (mon.0) 712 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.5768118 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.5819435 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.586878 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:15 smithi022 bash[26979]: audit 1689212714.5929697 mon.a (mon.0) 716 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: cluster 1689212713.6962998 mgr.a (mgr.14152) 486 : cluster 0 pgmap v385: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:15.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.1294045 mon.a (mon.0) 708 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.1370354 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.1375082 mon.a (mon.0) 710 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.5664244 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.5720184 mon.a (mon.0) 712 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.5768118 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.5819435 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.586878 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:15 smithi154 bash[27744]: audit 1689212714.5929697 mon.a (mon.0) 716 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: cluster 1689212713.6962998 mgr.a (mgr.14152) 486 : cluster 0 pgmap v385: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:15.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.1294045 mon.a (mon.0) 708 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.1370354 mon.a (mon.0) 709 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.1375082 mon.a (mon.0) 710 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.5664244 mon.a (mon.0) 711 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.5720184 mon.a (mon.0) 712 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.5768118 mon.a (mon.0) 713 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.5819435 mon.a (mon.0) 714 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.586878 mon.a (mon.0) 715 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:15.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:15 smithi137 bash[27262]: audit 1689212714.5929697 mon.a (mon.0) 716 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:16.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:16 smithi084 bash[27323]: audit 1689212715.279898 mon.a (mon.0) 717 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:16 smithi084 bash[27323]: audit 1689212715.280396 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:16 smithi022 bash[26979]: audit 1689212715.279898 mon.a (mon.0) 717 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:16 smithi022 bash[26979]: audit 1689212715.280396 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:16 smithi154 bash[27744]: audit 1689212715.279898 mon.a (mon.0) 717 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:16 smithi154 bash[27744]: audit 1689212715.280396 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:16 smithi137 bash[27262]: audit 1689212715.279898 mon.a (mon.0) 717 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:16 smithi137 bash[27262]: audit 1689212715.280396 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:16 smithi103 bash[27315]: audit 1689212715.279898 mon.a (mon.0) 717 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi137", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:16.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:16 smithi103 bash[27315]: audit 1689212715.280396 mon.a (mon.0) 718 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:17.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:17 smithi103 bash[27315]: cluster 1689212715.696751 mgr.a (mgr.14152) 487 : cluster 0 pgmap v386: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:17.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:17 smithi084 bash[27323]: cluster 1689212715.696751 mgr.a (mgr.14152) 487 : cluster 0 pgmap v386: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:17.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:17 smithi022 bash[26979]: cluster 1689212715.696751 mgr.a (mgr.14152) 487 : cluster 0 pgmap v386: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:17.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:17 smithi154 bash[27744]: cluster 1689212715.696751 mgr.a (mgr.14152) 487 : cluster 0 pgmap v386: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:17.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:17 smithi137 bash[27262]: cluster 1689212715.696751 mgr.a (mgr.14152) 487 : cluster 0 pgmap v386: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:18.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:17 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:45:18.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:17 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:18.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:17 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:19.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:19 smithi084 bash[27323]: cluster 1689212717.6972406 mgr.a (mgr.14152) 488 : cluster 0 pgmap v387: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:19.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:19 smithi022 bash[26979]: cluster 1689212717.6972406 mgr.a (mgr.14152) 488 : cluster 0 pgmap v387: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:19.432 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:19 smithi103 bash[27315]: cluster 1689212717.6972406 mgr.a (mgr.14152) 488 : cluster 0 pgmap v387: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:19.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:19 smithi154 bash[27744]: cluster 1689212717.6972406 mgr.a (mgr.14152) 488 : cluster 0 pgmap v387: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:19.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:19 smithi137 bash[27262]: cluster 1689212717.6972406 mgr.a (mgr.14152) 488 : cluster 0 pgmap v387: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:19.870 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:19 smithi103 bash[41836]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:19.871 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:19 smithi103 bash[41836]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:19.871 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:19 smithi103 bash[41836]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:19.871 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:19 smithi103 bash[41836]: --> Failed to activate any OSD(s) 2023-07-13T01:45:20.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:20 smithi084 bash[27323]: cluster 1689212719.6977353 mgr.a (mgr.14152) 489 : cluster 0 pgmap v388: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:20.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:20 smithi022 bash[26979]: cluster 1689212719.6977353 mgr.a (mgr.14152) 489 : cluster 0 pgmap v388: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:21.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:20 smithi154 bash[27744]: cluster 1689212719.6977353 mgr.a (mgr.14152) 489 : cluster 0 pgmap v388: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:20 smithi137 bash[27262]: cluster 1689212719.6977353 mgr.a (mgr.14152) 489 : cluster 0 pgmap v388: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:21.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:20 smithi103 bash[27315]: cluster 1689212719.6977353 mgr.a (mgr.14152) 489 : cluster 0 pgmap v388: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:22.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:21 smithi103 bash[27315]: audit 1689212720.8939252 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:21 smithi103 bash[27315]: audit 1689212720.9008331 mon.a (mon.0) 720 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:21 smithi103 bash[27315]: audit 1689212721.3781512 mon.a (mon.0) 721 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:22.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:21 smithi103 bash[27315]: audit 1689212721.380123 mon.a (mon.0) 722 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:22.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:21 smithi103 bash[27315]: audit 1689212721.3913972 mon.a (mon.0) 723 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:21 smithi084 bash[27323]: audit 1689212720.8939252 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:21 smithi084 bash[27323]: audit 1689212720.9008331 mon.a (mon.0) 720 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:21 smithi084 bash[27323]: audit 1689212721.3781512 mon.a (mon.0) 721 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:22.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:21 smithi084 bash[27323]: audit 1689212721.380123 mon.a (mon.0) 722 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:22.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:21 smithi084 bash[27323]: audit 1689212721.3913972 mon.a (mon.0) 723 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:21 smithi022 bash[26979]: audit 1689212720.8939252 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:21 smithi022 bash[26979]: audit 1689212720.9008331 mon.a (mon.0) 720 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:21 smithi022 bash[26979]: audit 1689212721.3781512 mon.a (mon.0) 721 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:22.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:21 smithi022 bash[26979]: audit 1689212721.380123 mon.a (mon.0) 722 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:22.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:21 smithi022 bash[26979]: audit 1689212721.3913972 mon.a (mon.0) 723 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:21 smithi154 bash[27744]: audit 1689212720.8939252 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:21 smithi154 bash[27744]: audit 1689212720.9008331 mon.a (mon.0) 720 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:21 smithi154 bash[27744]: audit 1689212721.3781512 mon.a (mon.0) 721 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:22.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:21 smithi154 bash[27744]: audit 1689212721.380123 mon.a (mon.0) 722 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:22.256 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:21 smithi154 bash[27744]: audit 1689212721.3913972 mon.a (mon.0) 723 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:21 smithi137 bash[27262]: audit 1689212720.8939252 mon.a (mon.0) 719 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:21 smithi137 bash[27262]: audit 1689212720.9008331 mon.a (mon.0) 720 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:22.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:21 smithi137 bash[27262]: audit 1689212721.3781512 mon.a (mon.0) 721 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:22.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:21 smithi137 bash[27262]: audit 1689212721.380123 mon.a (mon.0) 722 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:22.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:21 smithi137 bash[27262]: audit 1689212721.3913972 mon.a (mon.0) 723 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:23.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:22 smithi022 bash[26979]: cluster 1689212721.3837407 mgr.a (mgr.14152) 490 : cluster 0 pgmap v389: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:22 smithi022 bash[26979]: cluster 1689212721.384145 mgr.a (mgr.14152) 491 : cluster 0 pgmap v390: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:22 smithi154 bash[27744]: cluster 1689212721.3837407 mgr.a (mgr.14152) 490 : cluster 0 pgmap v389: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:22 smithi154 bash[27744]: cluster 1689212721.384145 mgr.a (mgr.14152) 491 : cluster 0 pgmap v390: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:22 smithi137 bash[27262]: cluster 1689212721.3837407 mgr.a (mgr.14152) 490 : cluster 0 pgmap v389: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:22 smithi137 bash[27262]: cluster 1689212721.384145 mgr.a (mgr.14152) 491 : cluster 0 pgmap v390: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:22 smithi103 bash[27315]: cluster 1689212721.3837407 mgr.a (mgr.14152) 490 : cluster 0 pgmap v389: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:22 smithi103 bash[27315]: cluster 1689212721.384145 mgr.a (mgr.14152) 491 : cluster 0 pgmap v390: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.354 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:23 smithi103 bash[42302]: debug 2023-07-13T01:45:23.146+0000 7f4ab79e5700 1 -- 172.21.15.103:0/183419886 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563a4ce34d00 con 0x563a4ce8ac00 2023-07-13T01:45:23.354 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:23 smithi103 bash[42302]: debug 2023-07-13T01:45:23.146+0000 7f4ac0b6a640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:23.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:22 smithi084 bash[27323]: cluster 1689212721.3837407 mgr.a (mgr.14152) 490 : cluster 0 pgmap v389: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:22 smithi084 bash[27323]: cluster 1689212721.384145 mgr.a (mgr.14152) 491 : cluster 0 pgmap v390: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:23.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:23 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:45:23.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:23 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:23.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:23 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:25.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:24 smithi103 bash[27315]: cluster 1689212723.3846383 mgr.a (mgr.14152) 492 : cluster 0 pgmap v391: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:25.103 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:24 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:25.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:24 smithi022 bash[26979]: cluster 1689212723.3846383 mgr.a (mgr.14152) 492 : cluster 0 pgmap v391: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:25.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:24 smithi154 bash[27744]: cluster 1689212723.3846383 mgr.a (mgr.14152) 492 : cluster 0 pgmap v391: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:25.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:24 smithi137 bash[27262]: cluster 1689212723.3846383 mgr.a (mgr.14152) 492 : cluster 0 pgmap v391: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:25.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:24 smithi084 bash[27323]: cluster 1689212723.3846383 mgr.a (mgr.14152) 492 : cluster 0 pgmap v391: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:26.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:26 smithi103 bash[42494]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:26.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:26 smithi103 bash[42494]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:26.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:26 smithi103 bash[42494]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:26.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:26 smithi103 bash[42494]: --> Failed to activate any OSD(s) 2023-07-13T01:45:27.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:26 smithi022 bash[26979]: cluster 1689212725.385123 mgr.a (mgr.14152) 493 : cluster 0 pgmap v392: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:27.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:26 smithi154 bash[27744]: cluster 1689212725.385123 mgr.a (mgr.14152) 493 : cluster 0 pgmap v392: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:27.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:26 smithi137 bash[27262]: cluster 1689212725.385123 mgr.a (mgr.14152) 493 : cluster 0 pgmap v392: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:27.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:26 smithi103 bash[27315]: cluster 1689212725.385123 mgr.a (mgr.14152) 493 : cluster 0 pgmap v392: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:27.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:26 smithi084 bash[27323]: cluster 1689212725.385123 mgr.a (mgr.14152) 493 : cluster 0 pgmap v392: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:27.493 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 8 on host 'smithi103' 2023-07-13T01:45:28.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:28 smithi154 bash[27744]: cluster 1689212727.3856122 mgr.a (mgr.14152) 494 : cluster 0 pgmap v393: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:28.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:28 smithi154 bash[27744]: audit 1689212727.461372 mon.a (mon.0) 724 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:28 smithi154 bash[27744]: audit 1689212727.4678626 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:28 smithi154 bash[27744]: audit 1689212727.490395 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:28.804 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:28 smithi137 bash[27262]: cluster 1689212727.3856122 mgr.a (mgr.14152) 494 : cluster 0 pgmap v393: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:28.804 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:28 smithi137 bash[27262]: audit 1689212727.461372 mon.a (mon.0) 724 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.804 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:28 smithi137 bash[27262]: audit 1689212727.4678626 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:28 smithi137 bash[27262]: audit 1689212727.490395 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:28.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:28 smithi103 bash[27315]: cluster 1689212727.3856122 mgr.a (mgr.14152) 494 : cluster 0 pgmap v393: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:28.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:28 smithi103 bash[27315]: audit 1689212727.461372 mon.a (mon.0) 724 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:28 smithi103 bash[27315]: audit 1689212727.4678626 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:28 smithi103 bash[27315]: audit 1689212727.490395 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:28.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:28 smithi084 bash[27323]: cluster 1689212727.3856122 mgr.a (mgr.14152) 494 : cluster 0 pgmap v393: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:28.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:28 smithi084 bash[27323]: audit 1689212727.461372 mon.a (mon.0) 724 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:28 smithi084 bash[27323]: audit 1689212727.4678626 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:28 smithi084 bash[27323]: audit 1689212727.490395 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:28.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:28 smithi022 bash[26979]: cluster 1689212727.3856122 mgr.a (mgr.14152) 494 : cluster 0 pgmap v393: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:28.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:28 smithi022 bash[26979]: audit 1689212727.461372 mon.a (mon.0) 724 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:28 smithi022 bash[26979]: audit 1689212727.4678626 mon.a (mon.0) 725 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:28.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:28 smithi022 bash[26979]: audit 1689212727.490395 mon.a (mon.0) 726 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:45:29.103 DEBUG:teuthology.orchestra.run.smithi103:osd.8> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service 2023-07-13T01:45:29.105 INFO:tasks.cephadm:Deploying osd.9 on smithi137 with /dev/vg_nvme/lv_4... 2023-07-13T01:45:29.106 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-13T01:45:29.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:28 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:45:29.685 INFO:journalctl@ceph.osd.8.smithi103.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:45:29.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:29 smithi103 bash[42870]: debug 2023-07-13T01:45:29.646+0000 7f5b32b60700 1 -- 172.21.15.103:0/2178892618 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560f640f8d00 con 0x560f6414ec00 2023-07-13T01:45:29.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:29 smithi103 bash[42870]: debug 2023-07-13T01:45:29.646+0000 7f5b3bce5640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:30.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:30 smithi103 bash[27315]: cluster 1689212729.386101 mgr.a (mgr.14152) 495 : cluster 0 pgmap v394: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:30.853 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:30 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:30.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:30 smithi084 bash[27323]: cluster 1689212729.386101 mgr.a (mgr.14152) 495 : cluster 0 pgmap v394: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:30.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:30 smithi022 bash[26979]: cluster 1689212729.386101 mgr.a (mgr.14152) 495 : cluster 0 pgmap v394: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:31.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:30 smithi154 bash[27744]: cluster 1689212729.386101 mgr.a (mgr.14152) 495 : cluster 0 pgmap v394: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:31.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:30 smithi137 bash[27262]: cluster 1689212729.386101 mgr.a (mgr.14152) 495 : cluster 0 pgmap v394: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:31.686 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:31 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:45:31.687 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:31 smithi103 systemd[1]: Stopped Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:31.687 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:31 smithi103 systemd[1]: Started Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:32.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:32 smithi084 bash[27323]: cluster 1689212731.386585 mgr.a (mgr.14152) 496 : cluster 0 pgmap v395: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:32.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:32 smithi022 bash[26979]: cluster 1689212731.386585 mgr.a (mgr.14152) 496 : cluster 0 pgmap v395: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:32.992 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:32 smithi103 bash[27315]: cluster 1689212731.386585 mgr.a (mgr.14152) 496 : cluster 0 pgmap v395: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:32.992 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:32 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:45:33.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:32 smithi154 bash[27744]: cluster 1689212731.386585 mgr.a (mgr.14152) 496 : cluster 0 pgmap v395: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:33.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:32 smithi137 bash[27262]: cluster 1689212731.386585 mgr.a (mgr.14152) 496 : cluster 0 pgmap v395: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:33.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:33 smithi103 bash[43139]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:33.603 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:33 smithi103 bash[43139]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:33.603 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:33 smithi103 bash[43139]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:33.603 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:33 smithi103 bash[43139]: --> Failed to activate any OSD(s) 2023-07-13T01:45:33.798 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.d/config 2023-07-13T01:45:34.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:34 smithi084 bash[27323]: cluster 1689212733.3871076 mgr.a (mgr.14152) 497 : cluster 0 pgmap v396: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:34.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:34 smithi022 bash[26979]: cluster 1689212733.3871076 mgr.a (mgr.14152) 497 : cluster 0 pgmap v396: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:34.981 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:34 smithi137 bash[27262]: cluster 1689212733.3871076 mgr.a (mgr.14152) 497 : cluster 0 pgmap v396: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:35.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:34 smithi154 bash[27744]: cluster 1689212733.3871076 mgr.a (mgr.14152) 497 : cluster 0 pgmap v396: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:35.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:34 smithi103 bash[27315]: cluster 1689212733.3871076 mgr.a (mgr.14152) 497 : cluster 0 pgmap v396: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:35.821 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:35 smithi103 bash[43272]: debug 2023-07-13T01:45:35.594+0000 7f0f20a09700 1 -- 172.21.15.103:0/3609691185 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5607a916ed00 con 0x5607a91c4c00 2023-07-13T01:45:35.822 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:35 smithi103 bash[43272]: debug 2023-07-13T01:45:35.594+0000 7f0f29b8e640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:36.574 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:36 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:36.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:36 smithi103 bash[27315]: cluster 1689212735.3875985 mgr.a (mgr.14152) 498 : cluster 0 pgmap v397: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:36.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:36 smithi084 bash[27323]: cluster 1689212735.3875985 mgr.a (mgr.14152) 498 : cluster 0 pgmap v397: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:36.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:36 smithi022 bash[26979]: cluster 1689212735.3875985 mgr.a (mgr.14152) 498 : cluster 0 pgmap v397: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:37.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:36 smithi154 bash[27744]: cluster 1689212735.3875985 mgr.a (mgr.14152) 498 : cluster 0 pgmap v397: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:37.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:36 smithi137 bash[27262]: cluster 1689212735.3875985 mgr.a (mgr.14152) 498 : cluster 0 pgmap v397: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:37.291 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-13T01:45:37.292 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-13T01:45:37.292 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2023-07-13T01:45:37.293 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2023-07-13T01:45:37.293 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0191247 s, 548 MB/s 2023-07-13T01:45:37.293 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2023-07-13T01:45:38.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi137:vg_nvme/lv_4 2023-07-13T01:45:38.827 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:38 smithi103 bash[27315]: cluster 1689212737.3880916 mgr.a (mgr.14152) 499 : cluster 0 pgmap v398: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:38.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:38 smithi084 bash[27323]: cluster 1689212737.3880916 mgr.a (mgr.14152) 499 : cluster 0 pgmap v398: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:38.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:38 smithi022 bash[26979]: cluster 1689212737.3880916 mgr.a (mgr.14152) 499 : cluster 0 pgmap v398: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:39.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:38 smithi154 bash[27744]: cluster 1689212737.3880916 mgr.a (mgr.14152) 499 : cluster 0 pgmap v398: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:39.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:38 smithi137 bash[27262]: cluster 1689212737.3880916 mgr.a (mgr.14152) 499 : cluster 0 pgmap v398: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:39.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:39 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:45:39.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:39 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:39.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:39 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:40.102 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:39 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Failed with result 'exit-code'. 2023-07-13T01:45:40.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: cluster 1689212739.3885717 mgr.a (mgr.14152) 500 : cluster 0 pgmap v399: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.5566566 mon.a (mon.0) 727 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.5649664 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.5667126 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.568134 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.569591 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.577764 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.5795581 mon.a (mon.0) 733 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:40.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.580995 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:40.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:40 smithi084 bash[27323]: audit 1689212740.5898855 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: cluster 1689212739.3885717 mgr.a (mgr.14152) 500 : cluster 0 pgmap v399: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:40.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.5566566 mon.a (mon.0) 727 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.5649664 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.5667126 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.568134 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.569591 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.577764 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.5795581 mon.a (mon.0) 733 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.580995 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:40.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:40 smithi022 bash[26979]: audit 1689212740.5898855 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.961 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: cluster 1689212739.3885717 mgr.a (mgr.14152) 500 : cluster 0 pgmap v399: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:40.962 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.5566566 mon.a (mon.0) 727 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.962 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.5649664 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.962 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.5667126 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.962 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.568134 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.962 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.569591 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:40.962 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.577764 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:40.963 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.5795581 mon.a (mon.0) 733 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:40.963 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.580995 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:40.963 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[27315]: audit 1689212740.5898855 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: cluster 1689212739.3885717 mgr.a (mgr.14152) 500 : cluster 0 pgmap v399: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:41.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.5566566 mon.a (mon.0) 727 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.5649664 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.5667126 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:41.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.568134 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:41.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.569591 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:41.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.577764 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.5795581 mon.a (mon.0) 733 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:41.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.580995 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:41.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:40 smithi154 bash[27744]: audit 1689212740.5898855 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: cluster 1689212739.3885717 mgr.a (mgr.14152) 500 : cluster 0 pgmap v399: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:41.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.5566566 mon.a (mon.0) 727 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.5649664 mon.a (mon.0) 728 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.5667126 mon.a (mon.0) 729 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:41.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.568134 mon.a (mon.0) 730 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:41.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.569591 mon.a (mon.0) 731 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:45:41.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.577764 mon.a (mon.0) 732 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.5795581 mon.a (mon.0) 733 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:41.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.580995 mon.a (mon.0) 734 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:45:41.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:40 smithi137 bash[27262]: audit 1689212740.5898855 mon.a (mon.0) 735 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:45:41.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[43672]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:41.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[43672]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:41.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[43672]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:41.353 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:40 smithi103 bash[43672]: --> Failed to activate any OSD(s) 2023-07-13T01:45:41.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:41 smithi084 bash[27323]: cephadm 1689212740.5463963 mgr.a (mgr.14152) 501 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:45:41.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:41 smithi084 bash[27323]: cephadm 1689212740.5706582 mgr.a (mgr.14152) 502 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:45:41.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:41 smithi084 bash[27323]: cluster 1689212740.5839279 mgr.a (mgr.14152) 503 : cluster 0 pgmap v400: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:41.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:41 smithi084 bash[27323]: cluster 1689212740.5842364 mgr.a (mgr.14152) 504 : cluster 0 pgmap v401: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:41.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:41 smithi022 bash[26979]: cephadm 1689212740.5463963 mgr.a (mgr.14152) 501 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:45:41.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:41 smithi022 bash[26979]: cephadm 1689212740.5706582 mgr.a (mgr.14152) 502 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:45:41.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:41 smithi022 bash[26979]: cluster 1689212740.5839279 mgr.a (mgr.14152) 503 : cluster 0 pgmap v400: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:41.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:41 smithi022 bash[26979]: cluster 1689212740.5842364 mgr.a (mgr.14152) 504 : cluster 0 pgmap v401: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:41 smithi154 bash[27744]: cephadm 1689212740.5463963 mgr.a (mgr.14152) 501 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:45:42.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:41 smithi154 bash[27744]: cephadm 1689212740.5706582 mgr.a (mgr.14152) 502 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:45:42.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:41 smithi154 bash[27744]: cluster 1689212740.5839279 mgr.a (mgr.14152) 503 : cluster 0 pgmap v400: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:41 smithi154 bash[27744]: cluster 1689212740.5842364 mgr.a (mgr.14152) 504 : cluster 0 pgmap v401: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:41 smithi137 bash[27262]: cephadm 1689212740.5463963 mgr.a (mgr.14152) 501 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:45:42.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:41 smithi137 bash[27262]: cephadm 1689212740.5706582 mgr.a (mgr.14152) 502 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:45:42.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:41 smithi137 bash[27262]: cluster 1689212740.5839279 mgr.a (mgr.14152) 503 : cluster 0 pgmap v400: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:41 smithi137 bash[27262]: cluster 1689212740.5842364 mgr.a (mgr.14152) 504 : cluster 0 pgmap v401: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:41 smithi103 bash[27315]: cephadm 1689212740.5463963 mgr.a (mgr.14152) 501 : cephadm 1 Detected new or changed devices on smithi103 2023-07-13T01:45:42.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:41 smithi103 bash[27315]: cephadm 1689212740.5706582 mgr.a (mgr.14152) 502 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:45:42.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:41 smithi103 bash[27315]: cluster 1689212740.5839279 mgr.a (mgr.14152) 503 : cluster 0 pgmap v400: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:41 smithi103 bash[27315]: cluster 1689212740.5842364 mgr.a (mgr.14152) 504 : cluster 0 pgmap v401: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:42.707 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.d/config 2023-07-13T01:45:42.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:42 smithi103 bash[44399]: debug 2023-07-13T01:45:42.710+0000 7f2d4e546700 1 -- 172.21.15.103:0/1831789124 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556d5144ed00 con 0x556d514a4800 2023-07-13T01:45:42.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:42 smithi103 bash[44399]: debug 2023-07-13T01:45:42.710+0000 7f2d576cb640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:43.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:42 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:45:43.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:42 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:43.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:42 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:43.897 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:43 smithi137 bash[27262]: cluster 1689212742.5847833 mgr.a (mgr.14152) 505 : cluster 0 pgmap v402: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:43.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:43 smithi022 bash[26979]: cluster 1689212742.5847833 mgr.a (mgr.14152) 505 : cluster 0 pgmap v402: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:44.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:43 smithi154 bash[27744]: cluster 1689212742.5847833 mgr.a (mgr.14152) 505 : cluster 0 pgmap v402: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:44.102 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:43 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:44.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:43 smithi103 bash[27315]: cluster 1689212742.5847833 mgr.a (mgr.14152) 505 : cluster 0 pgmap v402: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:44.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:43 smithi084 bash[27323]: cluster 1689212742.5847833 mgr.a (mgr.14152) 505 : cluster 0 pgmap v402: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:45.239 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:44 smithi103 bash[44510]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:45.239 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:44 smithi103 bash[44510]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:45.239 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:44 smithi103 bash[44510]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:45.239 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:44 smithi103 bash[44510]: --> Failed to activate any OSD(s) 2023-07-13T01:45:45.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:45 smithi022 bash[26979]: cluster 1689212744.5853598 mgr.a (mgr.14152) 506 : cluster 0 pgmap v403: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:46.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:45 smithi154 bash[27744]: cluster 1689212744.5853598 mgr.a (mgr.14152) 506 : cluster 0 pgmap v403: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:46.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:45 smithi137 bash[27262]: cluster 1689212744.5853598 mgr.a (mgr.14152) 506 : cluster 0 pgmap v403: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:46.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:45 smithi103 bash[27315]: cluster 1689212744.5853598 mgr.a (mgr.14152) 506 : cluster 0 pgmap v403: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:46.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:45 smithi084 bash[27323]: cluster 1689212744.5853598 mgr.a (mgr.14152) 506 : cluster 0 pgmap v403: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:46.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:46 smithi022 bash[26979]: audit 1689212745.8270967 mgr.a (mgr.14152) 507 : audit 0 from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:45:46.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:46 smithi022 bash[26979]: audit 1689212745.8346465 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:45:46.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:46 smithi022 bash[26979]: audit 1689212745.8411176 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:45:46.909 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:46 smithi022 bash[26979]: audit 1689212745.842606 mon.a (mon.0) 738 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:47.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:46 smithi154 bash[27744]: audit 1689212745.8270967 mgr.a (mgr.14152) 507 : audit 0 from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:45:47.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:46 smithi154 bash[27744]: audit 1689212745.8346465 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:45:47.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:46 smithi154 bash[27744]: audit 1689212745.8411176 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:45:47.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:46 smithi154 bash[27744]: audit 1689212745.842606 mon.a (mon.0) 738 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:47.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:46 smithi137 bash[27262]: audit 1689212745.8270967 mgr.a (mgr.14152) 507 : audit 0 from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:45:47.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:46 smithi137 bash[27262]: audit 1689212745.8346465 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:45:47.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:46 smithi137 bash[27262]: audit 1689212745.8411176 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:45:47.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:46 smithi137 bash[27262]: audit 1689212745.842606 mon.a (mon.0) 738 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:47.065 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:46 smithi103 bash[27315]: audit 1689212745.8270967 mgr.a (mgr.14152) 507 : audit 0 from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:45:47.065 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:46 smithi103 bash[27315]: audit 1689212745.8346465 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:45:47.065 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:46 smithi103 bash[27315]: audit 1689212745.8411176 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:45:47.065 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:46 smithi103 bash[27315]: audit 1689212745.842606 mon.a (mon.0) 738 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:47.065 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:46 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:45:47.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:46 smithi084 bash[27323]: audit 1689212745.8270967 mgr.a (mgr.14152) 507 : audit 0 from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:45:47.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:46 smithi084 bash[27323]: audit 1689212745.8346465 mon.a (mon.0) 736 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:45:47.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:46 smithi084 bash[27323]: audit 1689212745.8411176 mon.a (mon.0) 737 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:45:47.147 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:46 smithi084 bash[27323]: audit 1689212745.842606 mon.a (mon.0) 738 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:45:47.334 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:47 smithi103 bash[44754]: debug 2023-07-13T01:45:47.161+0000 7f6b41416700 1 -- 172.21.15.103:0/4228906209 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cee89ded00 con 0x55cee8a34c00 2023-07-13T01:45:47.335 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:47 smithi103 bash[44754]: debug 2023-07-13T01:45:47.161+0000 7f6b4a59b640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:47.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:47 smithi022 bash[26979]: cluster 1689212746.5859356 mgr.a (mgr.14152) 508 : cluster 0 pgmap v404: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:48.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:47 smithi154 bash[27744]: cluster 1689212746.5859356 mgr.a (mgr.14152) 508 : cluster 0 pgmap v404: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:48.010 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:47 smithi103 bash[27315]: cluster 1689212746.5859356 mgr.a (mgr.14152) 508 : cluster 0 pgmap v404: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:48.010 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:47 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:48.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:47 smithi137 bash[27262]: cluster 1689212746.5859356 mgr.a (mgr.14152) 508 : cluster 0 pgmap v404: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:48.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:47 smithi084 bash[27323]: cluster 1689212746.5859356 mgr.a (mgr.14152) 508 : cluster 0 pgmap v404: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:49.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:49 smithi103 bash[27315]: cluster 1689212748.586512 mgr.a (mgr.14152) 509 : cluster 0 pgmap v405: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:49.937 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:49 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:45:49.937 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:49 smithi103 systemd[1]: Stopped Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:49.937 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:49 smithi103 systemd[1]: Started Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:49 smithi154 bash[27744]: cluster 1689212748.586512 mgr.a (mgr.14152) 509 : cluster 0 pgmap v405: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:49 smithi137 bash[27262]: cluster 1689212748.586512 mgr.a (mgr.14152) 509 : cluster 0 pgmap v405: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:49 smithi084 bash[27323]: cluster 1689212748.586512 mgr.a (mgr.14152) 509 : cluster 0 pgmap v405: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:50.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:49 smithi022 bash[26979]: cluster 1689212748.586512 mgr.a (mgr.14152) 509 : cluster 0 pgmap v405: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:50.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:45:50 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:45:51.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:51 smithi103 bash[45008]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:51.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:51 smithi103 bash[45008]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:51.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:51 smithi103 bash[45008]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:51.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:51 smithi103 bash[45008]: --> Failed to activate any OSD(s) 2023-07-13T01:45:51.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:51 smithi103 bash[27315]: cluster 1689212750.5871258 mgr.a (mgr.14152) 510 : cluster 0 pgmap v406: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:52.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:51 smithi154 bash[27744]: cluster 1689212750.5871258 mgr.a (mgr.14152) 510 : cluster 0 pgmap v406: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:52.025 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:51 smithi137 bash[27262]: cluster 1689212750.5871258 mgr.a (mgr.14152) 510 : cluster 0 pgmap v406: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:51 smithi084 bash[27323]: cluster 1689212750.5871258 mgr.a (mgr.14152) 510 : cluster 0 pgmap v406: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:51 smithi022 bash[26979]: cluster 1689212750.5871258 mgr.a (mgr.14152) 510 : cluster 0 pgmap v406: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:53.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:53 smithi103 bash[45112]: debug 2023-07-13T01:45:53.241+0000 7fcc802d3700 1 -- 172.21.15.103:0/4119547205 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7bf534d00 con 0x55d7bf58ac00 2023-07-13T01:45:53.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:53 smithi103 bash[45112]: debug 2023-07-13T01:45:53.241+0000 7fcc89458640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:45:53.803 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:53 smithi137 bash[27262]: cluster 1689212752.587696 mgr.a (mgr.14152) 511 : cluster 0 pgmap v407: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:53.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:53 smithi103 bash[27315]: cluster 1689212752.587696 mgr.a (mgr.14152) 511 : cluster 0 pgmap v407: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:54.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:53 smithi154 bash[27744]: cluster 1689212752.587696 mgr.a (mgr.14152) 511 : cluster 0 pgmap v407: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:54.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:53 smithi084 bash[27323]: cluster 1689212752.587696 mgr.a (mgr.14152) 511 : cluster 0 pgmap v407: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:54.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:53 smithi022 bash[26979]: cluster 1689212752.587696 mgr.a (mgr.14152) 511 : cluster 0 pgmap v407: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:54.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:53 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:45:54.979 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5181725 mon.a (mon.0) 739 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:54.980 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.520706 mon.c (mon.2) 7 : audit 1 from='client.? 172.21.15.137:0/3164889974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:54.980 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.52875 mon.a (mon.0) 740 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]': finished 2023-07-13T01:45:54.980 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: cluster 1689212754.5288658 mon.a (mon.0) 741 : cluster 0 osdmap e14: 10 total, 0 up, 10 in 2023-07-13T01:45:54.981 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5291524 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:45:54.981 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5298457 mon.a (mon.0) 743 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:45:54.981 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5302885 mon.a (mon.0) 744 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:45:54.982 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.530742 mon.a (mon.0) 745 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:45:54.982 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5312078 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:45:54.982 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5316699 mon.a (mon.0) 747 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:45:54.982 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5320878 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:45:54.983 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5325382 mon.a (mon.0) 749 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:45:54.983 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.533001 mon.a (mon.0) 750 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:45:54.983 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:54 smithi103 bash[27315]: audit 1689212754.5334966 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:45:55.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5181725 mon.a (mon.0) 739 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.520706 mon.c (mon.2) 7 : audit 1 from='client.? 172.21.15.137:0/3164889974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.52875 mon.a (mon.0) 740 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]': finished 2023-07-13T01:45:55.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: cluster 1689212754.5288658 mon.a (mon.0) 741 : cluster 0 osdmap e14: 10 total, 0 up, 10 in 2023-07-13T01:45:55.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5291524 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:45:55.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5298457 mon.a (mon.0) 743 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:45:55.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5302885 mon.a (mon.0) 744 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:45:55.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.530742 mon.a (mon.0) 745 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:45:55.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5312078 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:45:55.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5316699 mon.a (mon.0) 747 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:45:55.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5320878 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:45:55.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5325382 mon.a (mon.0) 749 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:45:55.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.533001 mon.a (mon.0) 750 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:45:55.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:54 smithi154 bash[27744]: audit 1689212754.5334966 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:45:55.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5181725 mon.a (mon.0) 739 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.520706 mon.c (mon.2) 7 : audit 1 from='client.? 172.21.15.137:0/3164889974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.52875 mon.a (mon.0) 740 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]': finished 2023-07-13T01:45:55.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: cluster 1689212754.5288658 mon.a (mon.0) 741 : cluster 0 osdmap e14: 10 total, 0 up, 10 in 2023-07-13T01:45:55.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5291524 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:45:55.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5298457 mon.a (mon.0) 743 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:45:55.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5302885 mon.a (mon.0) 744 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:45:55.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.530742 mon.a (mon.0) 745 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:45:55.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5312078 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:45:55.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5316699 mon.a (mon.0) 747 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:45:55.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5320878 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:45:55.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5325382 mon.a (mon.0) 749 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:45:55.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.533001 mon.a (mon.0) 750 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:45:55.057 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:54 smithi137 bash[27262]: audit 1689212754.5334966 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:45:55.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5181725 mon.a (mon.0) 739 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.520706 mon.c (mon.2) 7 : audit 1 from='client.? 172.21.15.137:0/3164889974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.52875 mon.a (mon.0) 740 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]': finished 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: cluster 1689212754.5288658 mon.a (mon.0) 741 : cluster 0 osdmap e14: 10 total, 0 up, 10 in 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5291524 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5298457 mon.a (mon.0) 743 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5302885 mon.a (mon.0) 744 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:45:55.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.530742 mon.a (mon.0) 745 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:45:55.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5312078 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:45:55.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5316699 mon.a (mon.0) 747 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:45:55.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5320878 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:45:55.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5325382 mon.a (mon.0) 749 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:45:55.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.533001 mon.a (mon.0) 750 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:45:55.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:54 smithi084 bash[27323]: audit 1689212754.5334966 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:45:55.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5181725 mon.a (mon.0) 739 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.520706 mon.c (mon.2) 7 : audit 1 from='client.? 172.21.15.137:0/3164889974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]: dispatch 2023-07-13T01:45:55.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.52875 mon.a (mon.0) 740 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8021510-f8eb-4501-aa12-42109decd752"}]': finished 2023-07-13T01:45:55.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: cluster 1689212754.5288658 mon.a (mon.0) 741 : cluster 0 osdmap e14: 10 total, 0 up, 10 in 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5291524 mon.a (mon.0) 742 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5298457 mon.a (mon.0) 743 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5302885 mon.a (mon.0) 744 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.530742 mon.a (mon.0) 745 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5312078 mon.a (mon.0) 746 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5316699 mon.a (mon.0) 747 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:45:55.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5320878 mon.a (mon.0) 748 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:45:55.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5325382 mon.a (mon.0) 749 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:45:55.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.533001 mon.a (mon.0) 750 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:45:55.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:54 smithi022 bash[26979]: audit 1689212754.5334966 mon.a (mon.0) 751 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:45:55.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:55 smithi103 bash[27315]: cluster 1689212754.5883167 mgr.a (mgr.14152) 512 : cluster 0 pgmap v409: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:55.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:55 smithi103 bash[27315]: audit 1689212755.210545 mon.d (mon.3) 4 : audit 0 from='client.? 172.21.15.137:0/2546563453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:45:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:55 smithi154 bash[27744]: cluster 1689212754.5883167 mgr.a (mgr.14152) 512 : cluster 0 pgmap v409: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:56.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:55 smithi154 bash[27744]: audit 1689212755.210545 mon.d (mon.3) 4 : audit 0 from='client.? 172.21.15.137:0/2546563453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:45:56.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:55 smithi137 bash[27262]: cluster 1689212754.5883167 mgr.a (mgr.14152) 512 : cluster 0 pgmap v409: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:56.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:55 smithi137 bash[27262]: audit 1689212755.210545 mon.d (mon.3) 4 : audit 0 from='client.? 172.21.15.137:0/2546563453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:45:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:55 smithi084 bash[27323]: cluster 1689212754.5883167 mgr.a (mgr.14152) 512 : cluster 0 pgmap v409: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:55 smithi084 bash[27323]: audit 1689212755.210545 mon.d (mon.3) 4 : audit 0 from='client.? 172.21.15.137:0/2546563453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:45:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:55 smithi022 bash[26979]: cluster 1689212754.5883167 mgr.a (mgr.14152) 512 : cluster 0 pgmap v409: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:55 smithi022 bash[26979]: audit 1689212755.210545 mon.d (mon.3) 4 : audit 0 from='client.? 172.21.15.137:0/2546563453' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:45:56.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:45:56 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Failed with result 'exit-code'. 2023-07-13T01:45:57.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:56 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:45:57.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:56 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:57.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:56 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:45:58.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:57 smithi154 bash[27744]: cluster 1689212756.5889316 mgr.a (mgr.14152) 513 : cluster 0 pgmap v410: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:58.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:57 smithi137 bash[27262]: cluster 1689212756.5889316 mgr.a (mgr.14152) 513 : cluster 0 pgmap v410: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:58.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:57 smithi103 bash[27315]: cluster 1689212756.5889316 mgr.a (mgr.14152) 513 : cluster 0 pgmap v410: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:58.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:57 smithi084 bash[27323]: cluster 1689212756.5889316 mgr.a (mgr.14152) 513 : cluster 0 pgmap v410: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:58.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:57 smithi022 bash[26979]: cluster 1689212756.5889316 mgr.a (mgr.14152) 513 : cluster 0 pgmap v410: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:45:58.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:58 smithi103 bash[45369]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:58.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:58 smithi103 bash[45369]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:45:58.602 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:58 smithi103 bash[45369]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:45:58.603 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:58 smithi103 bash[45369]: --> Failed to activate any OSD(s) 2023-07-13T01:46:00.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:45:59 smithi154 bash[27744]: cluster 1689212758.5894728 mgr.a (mgr.14152) 514 : cluster 0 pgmap v411: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:00.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:45:59 smithi137 bash[27262]: cluster 1689212758.5894728 mgr.a (mgr.14152) 514 : cluster 0 pgmap v411: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:00.066 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:45:59 smithi103 bash[27315]: cluster 1689212758.5894728 mgr.a (mgr.14152) 514 : cluster 0 pgmap v411: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:00.066 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:59 smithi103 bash[45472]: debug 2023-07-13T01:45:59.857+0000 7f56e51b6700 1 -- 172.21.15.103:0/891937110 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561b36804d00 con 0x561b3685ac00 2023-07-13T01:46:00.066 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:45:59 smithi103 bash[45472]: debug 2023-07-13T01:45:59.857+0000 7f56ee33b640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:00.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:45:59 smithi084 bash[27323]: cluster 1689212758.5894728 mgr.a (mgr.14152) 514 : cluster 0 pgmap v411: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:00.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:45:59 smithi022 bash[26979]: cluster 1689212758.5894728 mgr.a (mgr.14152) 514 : cluster 0 pgmap v411: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:00.851 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:00 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:46:00.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:00 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:00.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:00 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:01.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:00 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:02.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:01 smithi154 bash[27744]: cluster 1689212760.5900018 mgr.a (mgr.14152) 515 : cluster 0 pgmap v412: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:02.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:01 smithi137 bash[27262]: cluster 1689212760.5900018 mgr.a (mgr.14152) 515 : cluster 0 pgmap v412: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:02.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:01 smithi103 bash[27315]: cluster 1689212760.5900018 mgr.a (mgr.14152) 515 : cluster 0 pgmap v412: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:02.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:01 smithi084 bash[27323]: cluster 1689212760.5900018 mgr.a (mgr.14152) 515 : cluster 0 pgmap v412: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:02.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:01 smithi022 bash[26979]: cluster 1689212760.5900018 mgr.a (mgr.14152) 515 : cluster 0 pgmap v412: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:02.851 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:02 smithi103 bash[45582]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:02.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:02 smithi103 bash[45582]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:02.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:02 smithi103 bash[45582]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:02.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:02 smithi103 bash[45582]: --> Failed to activate any OSD(s) 2023-07-13T01:46:04.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:03 smithi154 bash[27744]: cluster 1689212762.5906012 mgr.a (mgr.14152) 516 : cluster 0 pgmap v413: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:04.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:03 smithi137 bash[27262]: cluster 1689212762.5906012 mgr.a (mgr.14152) 516 : cluster 0 pgmap v413: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:04.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:03 smithi103 bash[27315]: cluster 1689212762.5906012 mgr.a (mgr.14152) 516 : cluster 0 pgmap v413: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:04.102 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:03 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:46:04.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:03 smithi084 bash[27323]: cluster 1689212762.5906012 mgr.a (mgr.14152) 516 : cluster 0 pgmap v413: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:04.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:03 smithi022 bash[26979]: cluster 1689212762.5906012 mgr.a (mgr.14152) 516 : cluster 0 pgmap v413: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:04.851 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:04 smithi103 bash[45831]: debug 2023-07-13T01:46:04.669+0000 7f2c3531e700 1 -- 172.21.15.103:0/480272665 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ceff26cd00 con 0x55ceff2c2800 2023-07-13T01:46:04.852 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:04 smithi103 bash[45831]: debug 2023-07-13T01:46:04.673+0000 7f2c3e4a3640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:05.695 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:05 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:05.851 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:05 smithi103 bash[27315]: cluster 1689212764.591202 mgr.a (mgr.14152) 517 : cluster 0 pgmap v414: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:06.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:05 smithi154 bash[27744]: cluster 1689212764.591202 mgr.a (mgr.14152) 517 : cluster 0 pgmap v414: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:06.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:05 smithi137 bash[27262]: cluster 1689212764.591202 mgr.a (mgr.14152) 517 : cluster 0 pgmap v414: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:06.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:05 smithi084 bash[27323]: cluster 1689212764.591202 mgr.a (mgr.14152) 517 : cluster 0 pgmap v414: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:06.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:05 smithi022 bash[26979]: cluster 1689212764.591202 mgr.a (mgr.14152) 517 : cluster 0 pgmap v414: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:06.851 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:06 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:46:06.852 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:06 smithi103 systemd[1]: Stopped Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:06.852 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:06 smithi103 systemd[1]: Started Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:07.967 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:07 smithi103 bash[27315]: cluster 1689212766.5917706 mgr.a (mgr.14152) 518 : cluster 0 pgmap v415: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:07.968 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:07 smithi103 bash[27315]: audit 1689212767.36294 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-13T01:46:07.968 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:07 smithi103 bash[27315]: audit 1689212767.3644953 mon.a (mon.0) 753 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:08.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:07 smithi154 bash[27744]: cluster 1689212766.5917706 mgr.a (mgr.14152) 518 : cluster 0 pgmap v415: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:08.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:07 smithi154 bash[27744]: audit 1689212767.36294 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-13T01:46:08.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:07 smithi154 bash[27744]: audit 1689212767.3644953 mon.a (mon.0) 753 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:08.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:07 smithi137 bash[27262]: cluster 1689212766.5917706 mgr.a (mgr.14152) 518 : cluster 0 pgmap v415: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:08.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:07 smithi137 bash[27262]: audit 1689212767.36294 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-13T01:46:08.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:07 smithi137 bash[27262]: audit 1689212767.3644953 mon.a (mon.0) 753 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:08.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:07 smithi084 bash[27323]: cluster 1689212766.5917706 mgr.a (mgr.14152) 518 : cluster 0 pgmap v415: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:08.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:07 smithi084 bash[27323]: audit 1689212767.36294 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-13T01:46:08.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:07 smithi084 bash[27323]: audit 1689212767.3644953 mon.a (mon.0) 753 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:08.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:07 smithi022 bash[26979]: cluster 1689212766.5917706 mgr.a (mgr.14152) 518 : cluster 0 pgmap v415: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:08.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:07 smithi022 bash[26979]: audit 1689212767.36294 mon.a (mon.0) 752 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-13T01:46:08.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:07 smithi022 bash[26979]: audit 1689212767.3644953 mon.a (mon.0) 753 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:08.342 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:07 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:46:08.601 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:08 smithi103 bash[46015]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:08.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:08 smithi103 bash[46015]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:08.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:08 smithi103 bash[46015]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:08.602 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:08 smithi103 bash[46015]: --> Failed to activate any OSD(s) 2023-07-13T01:46:08.851 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:08 smithi103 bash[27315]: cephadm 1689212767.3657355 mgr.a (mgr.14152) 519 : cephadm 1 Deploying daemon osd.9 on smithi137 2023-07-13T01:46:08.973 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:08 smithi137 bash[27262]: cephadm 1689212767.3657355 mgr.a (mgr.14152) 519 : cephadm 1 Deploying daemon osd.9 on smithi137 2023-07-13T01:46:09.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:08 smithi154 bash[27744]: cephadm 1689212767.3657355 mgr.a (mgr.14152) 519 : cephadm 1 Deploying daemon osd.9 on smithi137 2023-07-13T01:46:09.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:08 smithi084 bash[27323]: cephadm 1689212767.3657355 mgr.a (mgr.14152) 519 : cephadm 1 Deploying daemon osd.9 on smithi137 2023-07-13T01:46:09.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:08 smithi022 bash[26979]: cephadm 1689212767.3657355 mgr.a (mgr.14152) 519 : cephadm 1 Deploying daemon osd.9 on smithi137 2023-07-13T01:46:09.970 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:09 smithi103 bash[27315]: cluster 1689212768.592367 mgr.a (mgr.14152) 520 : cluster 0 pgmap v416: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:10.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:09 smithi154 bash[27744]: cluster 1689212768.592367 mgr.a (mgr.14152) 520 : cluster 0 pgmap v416: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:10.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:09 smithi137 bash[27262]: cluster 1689212768.592367 mgr.a (mgr.14152) 520 : cluster 0 pgmap v416: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:10.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:09 smithi084 bash[27323]: cluster 1689212768.592367 mgr.a (mgr.14152) 520 : cluster 0 pgmap v416: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:10.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:09 smithi022 bash[26979]: cluster 1689212768.592367 mgr.a (mgr.14152) 520 : cluster 0 pgmap v416: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:10.305 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:10 smithi103 bash[46193]: debug 2023-07-13T01:46:10.101+0000 7f573492f700 1 -- 172.21.15.103:0/3154851693 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e00f5bed00 con 0x55e00f614800 2023-07-13T01:46:10.305 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:10 smithi103 bash[46193]: debug 2023-07-13T01:46:10.101+0000 7f573dab4640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:11.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:10 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:11.802 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:11 smithi137 bash[27262]: cluster 1689212770.5928752 mgr.a (mgr.14152) 521 : cluster 0 pgmap v417: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:12.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:11 smithi154 bash[27744]: cluster 1689212770.5928752 mgr.a (mgr.14152) 521 : cluster 0 pgmap v417: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:12.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:11 smithi103 bash[27315]: cluster 1689212770.5928752 mgr.a (mgr.14152) 521 : cluster 0 pgmap v417: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:12.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:11 smithi084 bash[27323]: cluster 1689212770.5928752 mgr.a (mgr.14152) 521 : cluster 0 pgmap v417: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:12.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:11 smithi022 bash[26979]: cluster 1689212770.5928752 mgr.a (mgr.14152) 521 : cluster 0 pgmap v417: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:13.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:12 smithi154 bash[27744]: audit 1689212771.9784777 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:12 smithi154 bash[27744]: audit 1689212771.9861097 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:12 smithi154 bash[27744]: audit 1689212772.0088096 mon.a (mon.0) 756 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:13.280 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:12 smithi137 bash[27262]: audit 1689212771.9784777 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.281 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:12 smithi137 bash[27262]: audit 1689212771.9861097 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.281 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:12 smithi137 bash[27262]: audit 1689212772.0088096 mon.a (mon.0) 756 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:13.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:12 smithi103 bash[27315]: audit 1689212771.9784777 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:12 smithi103 bash[27315]: audit 1689212771.9861097 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:12 smithi103 bash[27315]: audit 1689212772.0088096 mon.a (mon.0) 756 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:13.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:12 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Failed with result 'exit-code'. 2023-07-13T01:46:13.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:12 smithi084 bash[27323]: audit 1689212771.9784777 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:12 smithi084 bash[27323]: audit 1689212771.9861097 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:12 smithi084 bash[27323]: audit 1689212772.0088096 mon.a (mon.0) 756 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:13.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:12 smithi022 bash[26979]: audit 1689212771.9784777 mon.a (mon.0) 754 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:12 smithi022 bash[26979]: audit 1689212771.9861097 mon.a (mon.0) 755 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:13.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:12 smithi022 bash[26979]: audit 1689212772.0088096 mon.a (mon.0) 756 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:14.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:13 smithi154 bash[27744]: cluster 1689212772.5933366 mgr.a (mgr.14152) 522 : cluster 0 pgmap v418: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:14.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:13 smithi137 bash[27262]: cluster 1689212772.5933366 mgr.a (mgr.14152) 522 : cluster 0 pgmap v418: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:14.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:13 smithi103 bash[27315]: cluster 1689212772.5933366 mgr.a (mgr.14152) 522 : cluster 0 pgmap v418: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:14.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:14 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 10. 2023-07-13T01:46:14.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:14 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:14.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:14 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:14.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:13 smithi084 bash[27323]: cluster 1689212772.5933366 mgr.a (mgr.14152) 522 : cluster 0 pgmap v418: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:14.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:13 smithi022 bash[26979]: cluster 1689212772.5933366 mgr.a (mgr.14152) 522 : cluster 0 pgmap v418: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:15.851 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:15 smithi103 bash[46449]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:15.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:15 smithi103 bash[46449]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:15.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:15 smithi103 bash[46449]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:15.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:15 smithi103 bash[46449]: --> Failed to activate any OSD(s) 2023-07-13T01:46:16.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:15 smithi137 bash[27262]: cluster 1689212774.593834 mgr.a (mgr.14152) 523 : cluster 0 pgmap v419: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:16.249 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:15 smithi103 bash[27315]: cluster 1689212774.593834 mgr.a (mgr.14152) 523 : cluster 0 pgmap v419: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:16.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:15 smithi154 bash[27744]: cluster 1689212774.593834 mgr.a (mgr.14152) 523 : cluster 0 pgmap v419: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:16.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:15 smithi084 bash[27323]: cluster 1689212774.593834 mgr.a (mgr.14152) 523 : cluster 0 pgmap v419: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:16.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:15 smithi022 bash[26979]: cluster 1689212774.593834 mgr.a (mgr.14152) 523 : cluster 0 pgmap v419: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:17.351 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:17 smithi103 bash[46553]: debug 2023-07-13T01:46:17.209+0000 7fcb0ec08700 1 -- 172.21.15.103:0/3920384941 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dd9333cd00 con 0x55dd93392c00 2023-07-13T01:46:17.352 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:17 smithi103 bash[46553]: debug 2023-07-13T01:46:17.209+0000 7fcb17d8d640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:18.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:18 smithi154 bash[27744]: cluster 1689212776.594321 mgr.a (mgr.14152) 524 : cluster 0 pgmap v420: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:18.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:18 smithi154 bash[27744]: audit 1689212777.5016847 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:18 smithi154 bash[27744]: audit 1689212777.5092459 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:18 smithi154 bash[27744]: audit 1689212777.9822938 mon.a (mon.0) 759 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:18.255 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:18 smithi154 bash[27744]: audit 1689212777.9841154 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:18.258 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:17 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:18.258 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:18 smithi103 bash[27315]: cluster 1689212776.594321 mgr.a (mgr.14152) 524 : cluster 0 pgmap v420: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:18.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:18 smithi103 bash[27315]: audit 1689212777.5016847 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:18 smithi103 bash[27315]: audit 1689212777.5092459 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:18 smithi103 bash[27315]: audit 1689212777.9822938 mon.a (mon.0) 759 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:18.259 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:18 smithi103 bash[27315]: audit 1689212777.9841154 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:18.259 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:18 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:46:18.259 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:18 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:18.260 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:18 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:18.290 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:18 smithi137 bash[27262]: cluster 1689212776.594321 mgr.a (mgr.14152) 524 : cluster 0 pgmap v420: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:18.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:18 smithi137 bash[27262]: audit 1689212777.5016847 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:18 smithi137 bash[27262]: audit 1689212777.5092459 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:18 smithi137 bash[27262]: audit 1689212777.9822938 mon.a (mon.0) 759 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:18.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:18 smithi137 bash[27262]: audit 1689212777.9841154 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:18.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:18 smithi084 bash[27323]: cluster 1689212776.594321 mgr.a (mgr.14152) 524 : cluster 0 pgmap v420: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:18.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:18 smithi084 bash[27323]: audit 1689212777.5016847 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:18 smithi084 bash[27323]: audit 1689212777.5092459 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:18 smithi084 bash[27323]: audit 1689212777.9822938 mon.a (mon.0) 759 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:18.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:18 smithi084 bash[27323]: audit 1689212777.9841154 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:18.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:18 smithi022 bash[26979]: cluster 1689212776.594321 mgr.a (mgr.14152) 524 : cluster 0 pgmap v420: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:18.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:18 smithi022 bash[26979]: audit 1689212777.5016847 mon.a (mon.0) 757 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:18 smithi022 bash[26979]: audit 1689212777.5092459 mon.a (mon.0) 758 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:18.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:18 smithi022 bash[26979]: audit 1689212777.9822938 mon.a (mon.0) 759 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:18.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:18 smithi022 bash[26979]: audit 1689212777.9841154 mon.a (mon.0) 760 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:19 smithi154 bash[27744]: cluster 1689212777.9874306 mgr.a (mgr.14152) 525 : cluster 0 pgmap v421: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:19 smithi154 bash[27744]: cluster 1689212777.987816 mgr.a (mgr.14152) 526 : cluster 0 pgmap v422: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:19 smithi154 bash[27744]: audit 1689212777.9956212 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:19 smithi154 bash[27744]: cluster 1689212778.505854 mon.a (mon.0) 762 : cluster 3 Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:46:19.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:19 smithi137 bash[27262]: cluster 1689212777.9874306 mgr.a (mgr.14152) 525 : cluster 0 pgmap v421: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:19 smithi137 bash[27262]: cluster 1689212777.987816 mgr.a (mgr.14152) 526 : cluster 0 pgmap v422: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:19 smithi137 bash[27262]: audit 1689212777.9956212 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:19.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:19 smithi137 bash[27262]: cluster 1689212778.505854 mon.a (mon.0) 762 : cluster 3 Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:46:19.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[27315]: cluster 1689212777.9874306 mgr.a (mgr.14152) 525 : cluster 0 pgmap v421: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[27315]: cluster 1689212777.987816 mgr.a (mgr.14152) 526 : cluster 0 pgmap v422: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[27315]: audit 1689212777.9956212 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:19.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[27315]: cluster 1689212778.505854 mon.a (mon.0) 762 : cluster 3 Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:46:19.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:19 smithi084 bash[27323]: cluster 1689212777.9874306 mgr.a (mgr.14152) 525 : cluster 0 pgmap v421: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:19 smithi084 bash[27323]: cluster 1689212777.987816 mgr.a (mgr.14152) 526 : cluster 0 pgmap v422: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:19 smithi084 bash[27323]: audit 1689212777.9956212 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:19.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:19 smithi084 bash[27323]: cluster 1689212778.505854 mon.a (mon.0) 762 : cluster 3 Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:46:19.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:19 smithi022 bash[26979]: cluster 1689212777.9874306 mgr.a (mgr.14152) 525 : cluster 0 pgmap v421: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:19 smithi022 bash[26979]: cluster 1689212777.987816 mgr.a (mgr.14152) 526 : cluster 0 pgmap v422: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:19.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:19 smithi022 bash[26979]: audit 1689212777.9956212 mon.a (mon.0) 761 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:19.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:19 smithi022 bash[26979]: cluster 1689212778.505854 mon.a (mon.0) 762 : cluster 3 Health check update: 9 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:46:20.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[46737]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:20.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[46737]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:20.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[46737]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:20.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:19 smithi103 bash[46737]: --> Failed to activate any OSD(s) 2023-07-13T01:46:20.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:20 smithi022 bash[26979]: cluster 1689212779.988243 mgr.a (mgr.14152) 527 : cluster 0 pgmap v423: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:21.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:20 smithi154 bash[27744]: cluster 1689212779.988243 mgr.a (mgr.14152) 527 : cluster 0 pgmap v423: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:20 smithi137 bash[27262]: cluster 1689212779.988243 mgr.a (mgr.14152) 527 : cluster 0 pgmap v423: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:21.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:20 smithi103 bash[27315]: cluster 1689212779.988243 mgr.a (mgr.14152) 527 : cluster 0 pgmap v423: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:21.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:20 smithi084 bash[27323]: cluster 1689212779.988243 mgr.a (mgr.14152) 527 : cluster 0 pgmap v423: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:21.403 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 9 on host 'smithi137' 2023-07-13T01:46:21.601 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:21 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:46:22.032 DEBUG:teuthology.orchestra.run.smithi137:osd.9> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service 2023-07-13T01:46:22.035 INFO:tasks.cephadm:Deploying osd.10 on smithi137 with /dev/vg_nvme/lv_3... 2023-07-13T01:46:22.036 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-13T01:46:22.245 INFO:journalctl@ceph.osd.9.smithi137.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:46:22.504 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:22 smithi103 bash[27315]: audit 1689212781.3748972 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.505 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:22 smithi103 bash[27315]: audit 1689212781.382396 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.505 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:22 smithi103 bash[27315]: audit 1689212781.3876784 mon.a (mon.0) 765 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:22.505 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:22 smithi103 bash[27315]: cluster 1689212781.9886572 mgr.a (mgr.14152) 528 : cluster 0 pgmap v424: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:22.505 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:22 smithi103 bash[46912]: debug 2023-07-13T01:46:22.285+0000 7f154134e700 1 -- 172.21.15.103:0/4226747111 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f2a42ed00 con 0x558f2a484c00 2023-07-13T01:46:22.505 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:22 smithi103 bash[46912]: debug 2023-07-13T01:46:22.285+0000 7f154a4d3640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:22.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:22 smithi084 bash[27323]: audit 1689212781.3748972 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:22 smithi084 bash[27323]: audit 1689212781.382396 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:22 smithi084 bash[27323]: audit 1689212781.3876784 mon.a (mon.0) 765 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:22.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:22 smithi084 bash[27323]: cluster 1689212781.9886572 mgr.a (mgr.14152) 528 : cluster 0 pgmap v424: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:22.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:22 smithi022 bash[26979]: audit 1689212781.3748972 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:22 smithi022 bash[26979]: audit 1689212781.382396 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:22 smithi022 bash[26979]: audit 1689212781.3876784 mon.a (mon.0) 765 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:22.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:22 smithi022 bash[26979]: cluster 1689212781.9886572 mgr.a (mgr.14152) 528 : cluster 0 pgmap v424: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:22.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:22 smithi154 bash[27744]: audit 1689212781.3748972 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:22 smithi154 bash[27744]: audit 1689212781.382396 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:22 smithi154 bash[27744]: audit 1689212781.3876784 mon.a (mon.0) 765 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:22.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:22 smithi154 bash[27744]: cluster 1689212781.9886572 mgr.a (mgr.14152) 528 : cluster 0 pgmap v424: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:22.802 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:22 smithi137 bash[27262]: audit 1689212781.3748972 mon.a (mon.0) 763 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.803 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:22 smithi137 bash[27262]: audit 1689212781.382396 mon.a (mon.0) 764 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:22.803 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:22 smithi137 bash[27262]: audit 1689212781.3876784 mon.a (mon.0) 765 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:46:22.803 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:22 smithi137 bash[27262]: cluster 1689212781.9886572 mgr.a (mgr.14152) 528 : cluster 0 pgmap v424: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:23.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:23 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:23.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:23 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:46:23.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:23 smithi103 systemd[1]: Stopped Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:23.352 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:23 smithi103 systemd[1]: Started Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:25.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:24 smithi103 bash[47067]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:25.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:24 smithi103 bash[47067]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:25.102 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:24 smithi103 bash[47067]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:25.102 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:24 smithi103 bash[47067]: --> Failed to activate any OSD(s) 2023-07-13T01:46:25.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:25 smithi103 bash[27315]: cluster 1689212783.9891195 mgr.a (mgr.14152) 529 : cluster 0 pgmap v425: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:25.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:25 smithi137 bash[27262]: cluster 1689212783.9891195 mgr.a (mgr.14152) 529 : cluster 0 pgmap v425: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:25.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:25 smithi084 bash[27323]: cluster 1689212783.9891195 mgr.a (mgr.14152) 529 : cluster 0 pgmap v425: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:25.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:25 smithi022 bash[26979]: cluster 1689212783.9891195 mgr.a (mgr.14152) 529 : cluster 0 pgmap v425: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:25.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:25 smithi154 bash[27744]: cluster 1689212783.9891195 mgr.a (mgr.14152) 529 : cluster 0 pgmap v425: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:26.249 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.d/config 2023-07-13T01:46:26.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:25 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:46:27.041 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:26 smithi103 bash[47282]: debug 2023-07-13T01:46:26.873+0000 7fb947dfe700 1 -- 172.21.15.103:0/3690971377 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a9d2c9ad00 con 0x55a9d2cf0800 2023-07-13T01:46:27.041 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:26 smithi103 bash[47282]: debug 2023-07-13T01:46:26.873+0000 7fb950f83640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:27.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:27 smithi137 bash[27262]: cluster 1689212785.989615 mgr.a (mgr.14152) 530 : cluster 0 pgmap v426: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:27.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:27 smithi103 bash[27315]: cluster 1689212785.989615 mgr.a (mgr.14152) 530 : cluster 0 pgmap v426: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:27.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:27 smithi084 bash[27323]: cluster 1689212785.989615 mgr.a (mgr.14152) 530 : cluster 0 pgmap v426: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:27.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:27 smithi022 bash[26979]: cluster 1689212785.989615 mgr.a (mgr.14152) 530 : cluster 0 pgmap v426: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:27.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:27 smithi154 bash[27744]: cluster 1689212785.989615 mgr.a (mgr.14152) 530 : cluster 0 pgmap v426: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:28.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:27 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:28.552 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:28 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:46:28.552 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:28 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:28.552 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:28 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:29.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:29 smithi137 bash[27262]: cluster 1689212787.9901285 mgr.a (mgr.14152) 531 : cluster 0 pgmap v427: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:29.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:29 smithi103 bash[27315]: cluster 1689212787.9901285 mgr.a (mgr.14152) 531 : cluster 0 pgmap v427: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:29.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:29 smithi084 bash[27323]: cluster 1689212787.9901285 mgr.a (mgr.14152) 531 : cluster 0 pgmap v427: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:29.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:29 smithi022 bash[26979]: cluster 1689212787.9901285 mgr.a (mgr.14152) 531 : cluster 0 pgmap v427: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:29.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:29 smithi154 bash[27744]: cluster 1689212787.9901285 mgr.a (mgr.14152) 531 : cluster 0 pgmap v427: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:30.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:29 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Failed with result 'exit-code'. 2023-07-13T01:46:30.655 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:30 smithi137 bash[31568]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:30.655 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:30 smithi137 bash[31568]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:30.655 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:30 smithi137 bash[31568]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:30.656 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:30 smithi137 bash[31568]: --> Failed to activate any OSD(s) 2023-07-13T01:46:30.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:30 smithi022 bash[26979]: cluster 1689212789.9907267 mgr.a (mgr.14152) 532 : cluster 0 pgmap v428: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:31.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:30 smithi154 bash[27744]: cluster 1689212789.9907267 mgr.a (mgr.14152) 532 : cluster 0 pgmap v428: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:31.037 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:30 smithi137 bash[27262]: cluster 1689212789.9907267 mgr.a (mgr.14152) 532 : cluster 0 pgmap v428: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:31.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:30 smithi103 bash[27315]: cluster 1689212789.9907267 mgr.a (mgr.14152) 532 : cluster 0 pgmap v428: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:31.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:30 smithi084 bash[27323]: cluster 1689212789.9907267 mgr.a (mgr.14152) 532 : cluster 0 pgmap v428: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:31.810 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-13T01:46:31.810 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-13T01:46:31.810 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2023-07-13T01:46:31.810 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2023-07-13T01:46:31.810 INFO:teuthology.orchestra.run.smithi137.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0167994 s, 624 MB/s 2023-07-13T01:46:31.811 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2023-07-13T01:46:31.851 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:31 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 11. 2023-07-13T01:46:31.851 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:31 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:31.852 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:31 smithi103 systemd[1]: Started Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:33.039 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:32 smithi103 bash[47538]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:33.040 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:32 smithi103 bash[47538]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:33.040 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:32 smithi103 bash[47538]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:33.040 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:32 smithi103 bash[47538]: --> Failed to activate any OSD(s) 2023-07-13T01:46:33.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi137:vg_nvme/lv_3 2023-07-13T01:46:33.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:33 smithi137 bash[27262]: cluster 1689212791.9913454 mgr.a (mgr.14152) 533 : cluster 0 pgmap v429: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:33.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:33 smithi103 bash[27315]: cluster 1689212791.9913454 mgr.a (mgr.14152) 533 : cluster 0 pgmap v429: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:33.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:33 smithi084 bash[27323]: cluster 1689212791.9913454 mgr.a (mgr.14152) 533 : cluster 0 pgmap v429: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:33.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:33 smithi022 bash[26979]: cluster 1689212791.9913454 mgr.a (mgr.14152) 533 : cluster 0 pgmap v429: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:33.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:33 smithi154 bash[27744]: cluster 1689212791.9913454 mgr.a (mgr.14152) 533 : cluster 0 pgmap v429: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:33.802 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:33 smithi137 bash[31799]: debug 2023-07-13T01:46:33.394+0000 7f210c2d2700 1 -- 172.21.15.137:0/674187186 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561a43926d00 con 0x561a4397d000 2023-07-13T01:46:33.802 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:33 smithi137 bash[31799]: debug 2023-07-13T01:46:33.394+0000 7f2115457640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:34.552 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:34 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:34.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: cephadm 1689212793.2633994 mgr.a (mgr.14152) 534 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:46:34.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.272696 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.2805572 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.2821767 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:46:34.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: cephadm 1689212793.28341 mgr.a (mgr.14152) 535 : cephadm 1 Adjusting osd_memory_target on smithi137 to 17265M 2023-07-13T01:46:34.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.2898617 mon.a (mon.0) 769 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.2914882 mon.a (mon.0) 770 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:34.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.2928345 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:34.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: cluster 1689212793.2956836 mgr.a (mgr.14152) 536 : cluster 0 pgmap v430: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: cluster 1689212793.295869 mgr.a (mgr.14152) 537 : cluster 0 pgmap v431: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:34 smithi137 bash[27262]: audit 1689212793.3017075 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.560 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[47645]: debug 2023-07-13T01:46:34.321+0000 7f064b9eb700 1 -- 172.21.15.103:0/3121936682 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561562ac6d00 con 0x561562b1cc00 2023-07-13T01:46:34.560 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[47645]: debug 2023-07-13T01:46:34.321+0000 7f0654b70640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:34.561 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: cephadm 1689212793.2633994 mgr.a (mgr.14152) 534 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:46:34.561 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.272696 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.561 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.2805572 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.561 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.2821767 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:46:34.561 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: cephadm 1689212793.28341 mgr.a (mgr.14152) 535 : cephadm 1 Adjusting osd_memory_target on smithi137 to 17265M 2023-07-13T01:46:34.562 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.2898617 mon.a (mon.0) 769 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.562 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.2914882 mon.a (mon.0) 770 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:34.562 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.2928345 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:34.562 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: cluster 1689212793.2956836 mgr.a (mgr.14152) 536 : cluster 0 pgmap v430: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.562 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: cluster 1689212793.295869 mgr.a (mgr.14152) 537 : cluster 0 pgmap v431: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.562 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:34 smithi103 bash[27315]: audit 1689212793.3017075 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: cephadm 1689212793.2633994 mgr.a (mgr.14152) 534 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:46:34.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.272696 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.2805572 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.2821767 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: cephadm 1689212793.28341 mgr.a (mgr.14152) 535 : cephadm 1 Adjusting osd_memory_target on smithi137 to 17265M 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.2898617 mon.a (mon.0) 769 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.2914882 mon.a (mon.0) 770 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.2928345 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: cluster 1689212793.2956836 mgr.a (mgr.14152) 536 : cluster 0 pgmap v430: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: cluster 1689212793.295869 mgr.a (mgr.14152) 537 : cluster 0 pgmap v431: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:34 smithi084 bash[27323]: audit 1689212793.3017075 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: cephadm 1689212793.2633994 mgr.a (mgr.14152) 534 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.272696 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.2805572 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.2821767 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: cephadm 1689212793.28341 mgr.a (mgr.14152) 535 : cephadm 1 Adjusting osd_memory_target on smithi137 to 17265M 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.2898617 mon.a (mon.0) 769 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.2914882 mon.a (mon.0) 770 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:34.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.2928345 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:34.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: cluster 1689212793.2956836 mgr.a (mgr.14152) 536 : cluster 0 pgmap v430: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: cluster 1689212793.295869 mgr.a (mgr.14152) 537 : cluster 0 pgmap v431: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:34 smithi022 bash[26979]: audit 1689212793.3017075 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: cephadm 1689212793.2633994 mgr.a (mgr.14152) 534 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:46:34.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.272696 mon.a (mon.0) 766 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.2805572 mon.a (mon.0) 767 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.2821767 mon.a (mon.0) 768 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:46:34.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: cephadm 1689212793.28341 mgr.a (mgr.14152) 535 : cephadm 1 Adjusting osd_memory_target on smithi137 to 17265M 2023-07-13T01:46:34.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.2898617 mon.a (mon.0) 769 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:34.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.2914882 mon.a (mon.0) 770 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:34.756 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.2928345 mon.a (mon.0) 771 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:46:34.756 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: cluster 1689212793.2956836 mgr.a (mgr.14152) 536 : cluster 0 pgmap v430: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.756 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: cluster 1689212793.295869 mgr.a (mgr.14152) 537 : cluster 0 pgmap v431: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:34.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:34 smithi154 bash[27744]: audit 1689212793.3017075 mon.a (mon.0) 772 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:46:35.351 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:35 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:36.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:35 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:46:36.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:35 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:36.352 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:35 smithi103 systemd[1]: Started Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:36.652 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:36 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:46:36.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:36 smithi022 bash[26979]: cluster 1689212795.2963145 mgr.a (mgr.14152) 538 : cluster 0 pgmap v432: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:37.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:36 smithi154 bash[27744]: cluster 1689212795.2963145 mgr.a (mgr.14152) 538 : cluster 0 pgmap v432: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:37.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:36 smithi137 bash[27262]: cluster 1689212795.2963145 mgr.a (mgr.14152) 538 : cluster 0 pgmap v432: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:37.055 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:36 smithi103 bash[27315]: cluster 1689212795.2963145 mgr.a (mgr.14152) 538 : cluster 0 pgmap v432: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:37.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:36 smithi084 bash[27323]: cluster 1689212795.2963145 mgr.a (mgr.14152) 538 : cluster 0 pgmap v432: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:37.603 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:37 smithi103 bash[47825]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:37.603 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:37 smithi103 bash[47825]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:37.604 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:37 smithi103 bash[47825]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:37.604 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:37 smithi103 bash[47825]: --> Failed to activate any OSD(s) 2023-07-13T01:46:37.800 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.d/config 2023-07-13T01:46:38.601 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:38 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:46:38.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:38 smithi022 bash[26979]: cluster 1689212797.2967901 mgr.a (mgr.14152) 539 : cluster 0 pgmap v433: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:38.953 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:38 smithi137 bash[27262]: cluster 1689212797.2967901 mgr.a (mgr.14152) 539 : cluster 0 pgmap v433: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:38 smithi154 bash[27744]: cluster 1689212797.2967901 mgr.a (mgr.14152) 539 : cluster 0 pgmap v433: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:39.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:38 smithi103 bash[27315]: cluster 1689212797.2967901 mgr.a (mgr.14152) 539 : cluster 0 pgmap v433: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:38 smithi084 bash[27323]: cluster 1689212797.2967901 mgr.a (mgr.14152) 539 : cluster 0 pgmap v433: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:39.701 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:39 smithi103 bash[48001]: debug 2023-07-13T01:46:39.508+0000 7fd646860700 1 -- 172.21.15.103:0/3967701982 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d77229ad00 con 0x55d7722f0800 2023-07-13T01:46:39.701 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:39 smithi103 bash[48001]: debug 2023-07-13T01:46:39.512+0000 7fd64f9e5640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:40.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:39 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:46:40.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:39 smithi103 systemd[1]: Stopped Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:40.101 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:39 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Start request repeated too quickly. 2023-07-13T01:46:40.102 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:39 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service: Failed with result 'exit-code'. 2023-07-13T01:46:40.102 INFO:journalctl@ceph.osd.8.smithi103.stdout:Jul 13 01:46:39 smithi103 systemd[1]: Failed to start Ceph osd.8 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:40.601 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:40 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:40.802 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:40 smithi137 bash[27262]: cluster 1689212799.2973287 mgr.a (mgr.14152) 540 : cluster 0 pgmap v434: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:41.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:40 smithi154 bash[27744]: cluster 1689212799.2973287 mgr.a (mgr.14152) 540 : cluster 0 pgmap v434: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:41.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:40 smithi103 bash[27315]: cluster 1689212799.2973287 mgr.a (mgr.14152) 540 : cluster 0 pgmap v434: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:41.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:40 smithi084 bash[27323]: cluster 1689212799.2973287 mgr.a (mgr.14152) 540 : cluster 0 pgmap v434: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:41.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:40 smithi022 bash[26979]: cluster 1689212799.2973287 mgr.a (mgr.14152) 540 : cluster 0 pgmap v434: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:41.925 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:41 smithi103 bash[27315]: audit 1689212800.953288 mgr.a (mgr.14152) 541 : audit 0 from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:46:41.926 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:41 smithi103 bash[27315]: audit 1689212800.9606073 mon.a (mon.0) 773 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:46:41.926 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:41 smithi103 bash[27315]: audit 1689212800.966748 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:46:41.926 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:41 smithi103 bash[27315]: audit 1689212800.9678774 mon.a (mon.0) 775 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:42.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:41 smithi154 bash[27744]: audit 1689212800.953288 mgr.a (mgr.14152) 541 : audit 0 from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:46:42.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:41 smithi154 bash[27744]: audit 1689212800.9606073 mon.a (mon.0) 773 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:46:42.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:41 smithi154 bash[27744]: audit 1689212800.966748 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:46:42.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:41 smithi154 bash[27744]: audit 1689212800.9678774 mon.a (mon.0) 775 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:42.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:41 smithi137 bash[27262]: audit 1689212800.953288 mgr.a (mgr.14152) 541 : audit 0 from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:46:42.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:41 smithi137 bash[27262]: audit 1689212800.9606073 mon.a (mon.0) 773 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:46:42.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:41 smithi137 bash[27262]: audit 1689212800.966748 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:46:42.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:41 smithi137 bash[27262]: audit 1689212800.9678774 mon.a (mon.0) 775 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:42.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:41 smithi084 bash[27323]: audit 1689212800.953288 mgr.a (mgr.14152) 541 : audit 0 from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:46:42.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:41 smithi084 bash[27323]: audit 1689212800.9606073 mon.a (mon.0) 773 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:46:42.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:41 smithi084 bash[27323]: audit 1689212800.966748 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:46:42.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:41 smithi084 bash[27323]: audit 1689212800.9678774 mon.a (mon.0) 775 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:42.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:41 smithi022 bash[26979]: audit 1689212800.953288 mgr.a (mgr.14152) 541 : audit 0 from='client.24536 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:46:42.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:41 smithi022 bash[26979]: audit 1689212800.9606073 mon.a (mon.0) 773 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:46:42.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:41 smithi022 bash[26979]: audit 1689212800.966748 mon.a (mon.0) 774 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:46:42.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:41 smithi022 bash[26979]: audit 1689212800.9678774 mon.a (mon.0) 775 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:46:42.851 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:42 smithi103 bash[27315]: cluster 1689212801.29794 mgr.a (mgr.14152) 542 : cluster 0 pgmap v435: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:42.851 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:42 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:46:43.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:42 smithi154 bash[27744]: cluster 1689212801.29794 mgr.a (mgr.14152) 542 : cluster 0 pgmap v435: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:43.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:42 smithi137 bash[27262]: cluster 1689212801.29794 mgr.a (mgr.14152) 542 : cluster 0 pgmap v435: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:43.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:42 smithi084 bash[27323]: cluster 1689212801.29794 mgr.a (mgr.14152) 542 : cluster 0 pgmap v435: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:43.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:42 smithi022 bash[26979]: cluster 1689212801.29794 mgr.a (mgr.14152) 542 : cluster 0 pgmap v435: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:45.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:44 smithi154 bash[27744]: cluster 1689212803.298468 mgr.a (mgr.14152) 543 : cluster 0 pgmap v436: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:45.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:44 smithi137 bash[27262]: cluster 1689212803.298468 mgr.a (mgr.14152) 543 : cluster 0 pgmap v436: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:45.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:44 smithi103 bash[27315]: cluster 1689212803.298468 mgr.a (mgr.14152) 543 : cluster 0 pgmap v436: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:45.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:44 smithi084 bash[27323]: cluster 1689212803.298468 mgr.a (mgr.14152) 543 : cluster 0 pgmap v436: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:45.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:44 smithi022 bash[26979]: cluster 1689212803.298468 mgr.a (mgr.14152) 543 : cluster 0 pgmap v436: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:47.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:46 smithi154 bash[27744]: cluster 1689212805.29899 mgr.a (mgr.14152) 544 : cluster 0 pgmap v437: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:47.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:46 smithi137 bash[27262]: cluster 1689212805.29899 mgr.a (mgr.14152) 544 : cluster 0 pgmap v437: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:47.052 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:46 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:46:47.053 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:46 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:47.053 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:46 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:47.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:46 smithi103 bash[27315]: cluster 1689212805.29899 mgr.a (mgr.14152) 544 : cluster 0 pgmap v437: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:47.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:46 smithi084 bash[27323]: cluster 1689212805.29899 mgr.a (mgr.14152) 544 : cluster 0 pgmap v437: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:47.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:46 smithi022 bash[26979]: cluster 1689212805.29899 mgr.a (mgr.14152) 544 : cluster 0 pgmap v437: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:48.683 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:48 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Scheduled restart job, restart counter is at 12. 2023-07-13T01:46:48.684 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:48 smithi103 systemd[1]: Stopped Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:48.684 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:48 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Start request repeated too quickly. 2023-07-13T01:46:48.684 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:48 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service: Failed with result 'exit-code'. 2023-07-13T01:46:48.684 INFO:journalctl@ceph.osd.6.smithi103.stdout:Jul 13 01:46:48 smithi103 systemd[1]: Failed to start Ceph osd.6 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:48.977 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:48 smithi137 bash[27262]: cluster 1689212807.2994382 mgr.a (mgr.14152) 545 : cluster 0 pgmap v438: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:48.977 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:48 smithi137 bash[33144]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:48.977 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:48 smithi137 bash[33144]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:46:48.977 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:48 smithi137 bash[33144]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:46:48.977 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:48 smithi137 bash[33144]: --> Failed to activate any OSD(s) 2023-07-13T01:46:49.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:48 smithi154 bash[27744]: cluster 1689212807.2994382 mgr.a (mgr.14152) 545 : cluster 0 pgmap v438: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:49.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:48 smithi103 bash[27315]: cluster 1689212807.2994382 mgr.a (mgr.14152) 545 : cluster 0 pgmap v438: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:49.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:48 smithi084 bash[27323]: cluster 1689212807.2994382 mgr.a (mgr.14152) 545 : cluster 0 pgmap v438: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:49.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:48 smithi022 bash[26979]: cluster 1689212807.2994382 mgr.a (mgr.14152) 545 : cluster 0 pgmap v438: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:50.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: cluster 1689212809.659919 mon.a (mon.0) 776 : cluster 1 Marking osd.0 out (has been down for 603 seconds) 2023-07-13T01:46:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: cluster 1689212809.669789 mon.a (mon.0) 777 : cluster 0 osdmap e15: 10 total, 0 up, 9 in 2023-07-13T01:46:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6704545 mon.a (mon.0) 778 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6712625 mon.a (mon.0) 779 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6745987 mon.a (mon.0) 780 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6751406 mon.a (mon.0) 781 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:50.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.675449 mon.a (mon.0) 782 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:50.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6757412 mon.a (mon.0) 783 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:50.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6760166 mon.a (mon.0) 784 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:50.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.676289 mon.a (mon.0) 785 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:50.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.6765592 mon.a (mon.0) 786 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:50.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:49 smithi154 bash[27744]: audit 1689212809.67683 mon.a (mon.0) 787 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: cluster 1689212809.659919 mon.a (mon.0) 776 : cluster 1 Marking osd.0 out (has been down for 603 seconds) 2023-07-13T01:46:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: cluster 1689212809.669789 mon.a (mon.0) 777 : cluster 0 osdmap e15: 10 total, 0 up, 9 in 2023-07-13T01:46:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6704545 mon.a (mon.0) 778 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6712625 mon.a (mon.0) 779 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6745987 mon.a (mon.0) 780 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6751406 mon.a (mon.0) 781 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.675449 mon.a (mon.0) 782 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6757412 mon.a (mon.0) 783 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6760166 mon.a (mon.0) 784 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.676289 mon.a (mon.0) 785 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.6765592 mon.a (mon.0) 786 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:49 smithi137 bash[27262]: audit 1689212809.67683 mon.a (mon.0) 787 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: cluster 1689212809.659919 mon.a (mon.0) 776 : cluster 1 Marking osd.0 out (has been down for 603 seconds) 2023-07-13T01:46:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: cluster 1689212809.669789 mon.a (mon.0) 777 : cluster 0 osdmap e15: 10 total, 0 up, 9 in 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6704545 mon.a (mon.0) 778 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6712625 mon.a (mon.0) 779 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6745987 mon.a (mon.0) 780 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6751406 mon.a (mon.0) 781 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.675449 mon.a (mon.0) 782 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6757412 mon.a (mon.0) 783 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6760166 mon.a (mon.0) 784 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.676289 mon.a (mon.0) 785 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:50.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.6765592 mon.a (mon.0) 786 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:50.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:49 smithi103 bash[27315]: audit 1689212809.67683 mon.a (mon.0) 787 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:50.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: cluster 1689212809.659919 mon.a (mon.0) 776 : cluster 1 Marking osd.0 out (has been down for 603 seconds) 2023-07-13T01:46:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: cluster 1689212809.669789 mon.a (mon.0) 777 : cluster 0 osdmap e15: 10 total, 0 up, 9 in 2023-07-13T01:46:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6704545 mon.a (mon.0) 778 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6712625 mon.a (mon.0) 779 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6745987 mon.a (mon.0) 780 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6751406 mon.a (mon.0) 781 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.675449 mon.a (mon.0) 782 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6757412 mon.a (mon.0) 783 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6760166 mon.a (mon.0) 784 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.676289 mon.a (mon.0) 785 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.6765592 mon.a (mon.0) 786 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:49 smithi084 bash[27323]: audit 1689212809.67683 mon.a (mon.0) 787 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: cluster 1689212809.659919 mon.a (mon.0) 776 : cluster 1 Marking osd.0 out (has been down for 603 seconds) 2023-07-13T01:46:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: cluster 1689212809.669789 mon.a (mon.0) 777 : cluster 0 osdmap e15: 10 total, 0 up, 9 in 2023-07-13T01:46:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6704545 mon.a (mon.0) 778 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6712625 mon.a (mon.0) 779 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6745987 mon.a (mon.0) 780 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:50.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6751406 mon.a (mon.0) 781 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:50.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.675449 mon.a (mon.0) 782 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:50.160 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6757412 mon.a (mon.0) 783 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:50.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6760166 mon.a (mon.0) 784 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:50.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.676289 mon.a (mon.0) 785 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:50.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.6765592 mon.a (mon.0) 786 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:50.161 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:49 smithi022 bash[26979]: audit 1689212809.67683 mon.a (mon.0) 787 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:50.968 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:50 smithi137 bash[27262]: cluster 1689212809.2999167 mgr.a (mgr.14152) 546 : cluster 0 pgmap v439: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:51.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:50 smithi154 bash[27744]: cluster 1689212809.2999167 mgr.a (mgr.14152) 546 : cluster 0 pgmap v439: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:51.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:50 smithi103 bash[27315]: cluster 1689212809.2999167 mgr.a (mgr.14152) 546 : cluster 0 pgmap v439: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:51.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:50 smithi084 bash[27323]: cluster 1689212809.2999167 mgr.a (mgr.14152) 546 : cluster 0 pgmap v439: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:51.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:50 smithi022 bash[26979]: cluster 1689212809.2999167 mgr.a (mgr.14152) 546 : cluster 0 pgmap v439: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:51.301 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[33330]: debug 2023-07-13T01:46:51.014+0000 7f7dc6135700 1 -- 172.21.15.137:0/1405393783 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b233baed00 con 0x55b233c05000 2023-07-13T01:46:51.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[33330]: debug 2023-07-13T01:46:51.014+0000 7f7dcf2ba640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:46:51.954 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:51 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:46:51.954 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1513562 mon.a (mon.0) 788 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:51.955 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1530263 mon.d (mon.3) 5 : audit 1 from='client.? 172.21.15.137:0/356834658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:51.955 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1613626 mon.a (mon.0) 789 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]': finished 2023-07-13T01:46:51.955 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: cluster 1689212811.1615055 mon.a (mon.0) 790 : cluster 0 osdmap e16: 11 total, 0 up, 10 in 2023-07-13T01:46:51.955 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.161693 mon.a (mon.0) 791 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:51.955 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.162308 mon.a (mon.0) 792 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:51.956 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.162962 mon.a (mon.0) 793 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:51.956 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1637862 mon.a (mon.0) 794 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:51.956 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1641958 mon.a (mon.0) 795 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:51.956 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1646137 mon.a (mon.0) 796 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:51.956 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1650052 mon.a (mon.0) 797 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:51.957 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1653152 mon.a (mon.0) 798 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:51.957 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1655843 mon.a (mon.0) 799 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:51.957 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1658564 mon.a (mon.0) 800 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:51.957 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:51 smithi137 bash[27262]: audit 1689212811.1662104 mon.a (mon.0) 801 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:46:52.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1513562 mon.a (mon.0) 788 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1530263 mon.d (mon.3) 5 : audit 1 from='client.? 172.21.15.137:0/356834658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1613626 mon.a (mon.0) 789 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]': finished 2023-07-13T01:46:52.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: cluster 1689212811.1615055 mon.a (mon.0) 790 : cluster 0 osdmap e16: 11 total, 0 up, 10 in 2023-07-13T01:46:52.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.161693 mon.a (mon.0) 791 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:52.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.162308 mon.a (mon.0) 792 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.162962 mon.a (mon.0) 793 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1637862 mon.a (mon.0) 794 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1641958 mon.a (mon.0) 795 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1646137 mon.a (mon.0) 796 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1650052 mon.a (mon.0) 797 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1653152 mon.a (mon.0) 798 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:52.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1655843 mon.a (mon.0) 799 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:52.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1658564 mon.a (mon.0) 800 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:52.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:51 smithi154 bash[27744]: audit 1689212811.1662104 mon.a (mon.0) 801 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:46:52.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1513562 mon.a (mon.0) 788 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1530263 mon.d (mon.3) 5 : audit 1 from='client.? 172.21.15.137:0/356834658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1613626 mon.a (mon.0) 789 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]': finished 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: cluster 1689212811.1615055 mon.a (mon.0) 790 : cluster 0 osdmap e16: 11 total, 0 up, 10 in 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.161693 mon.a (mon.0) 791 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.162308 mon.a (mon.0) 792 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.162962 mon.a (mon.0) 793 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1637862 mon.a (mon.0) 794 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:52.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1641958 mon.a (mon.0) 795 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:52.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1646137 mon.a (mon.0) 796 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:52.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1650052 mon.a (mon.0) 797 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:52.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1653152 mon.a (mon.0) 798 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:52.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1655843 mon.a (mon.0) 799 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:52.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1658564 mon.a (mon.0) 800 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:52.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:51 smithi103 bash[27315]: audit 1689212811.1662104 mon.a (mon.0) 801 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:46:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1513562 mon.a (mon.0) 788 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1530263 mon.d (mon.3) 5 : audit 1 from='client.? 172.21.15.137:0/356834658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1613626 mon.a (mon.0) 789 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]': finished 2023-07-13T01:46:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: cluster 1689212811.1615055 mon.a (mon.0) 790 : cluster 0 osdmap e16: 11 total, 0 up, 10 in 2023-07-13T01:46:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.161693 mon.a (mon.0) 791 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:52.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.162308 mon.a (mon.0) 792 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.162962 mon.a (mon.0) 793 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1637862 mon.a (mon.0) 794 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1641958 mon.a (mon.0) 795 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1646137 mon.a (mon.0) 796 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1650052 mon.a (mon.0) 797 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1653152 mon.a (mon.0) 798 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:52.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1655843 mon.a (mon.0) 799 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:52.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1658564 mon.a (mon.0) 800 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:52.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:51 smithi084 bash[27323]: audit 1689212811.1662104 mon.a (mon.0) 801 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:46:52.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1513562 mon.a (mon.0) 788 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1530263 mon.d (mon.3) 5 : audit 1 from='client.? 172.21.15.137:0/356834658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]: dispatch 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1613626 mon.a (mon.0) 789 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "434ba87d-8acd-4585-aa68-643bd702c64c"}]': finished 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: cluster 1689212811.1615055 mon.a (mon.0) 790 : cluster 0 osdmap e16: 11 total, 0 up, 10 in 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.161693 mon.a (mon.0) 791 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.162308 mon.a (mon.0) 792 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.162962 mon.a (mon.0) 793 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1637862 mon.a (mon.0) 794 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:46:52.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1641958 mon.a (mon.0) 795 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:46:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1646137 mon.a (mon.0) 796 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:46:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1650052 mon.a (mon.0) 797 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:46:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1653152 mon.a (mon.0) 798 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:46:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1655843 mon.a (mon.0) 799 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:46:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1658564 mon.a (mon.0) 800 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:46:52.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:51 smithi022 bash[26979]: audit 1689212811.1662104 mon.a (mon.0) 801 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:46:53.101 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:52 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:46:53.101 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:52 smithi103 systemd[1]: Stopped Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:53.101 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:52 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Start request repeated too quickly. 2023-07-13T01:46:53.101 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:52 smithi103 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service: Failed with result 'exit-code'. 2023-07-13T01:46:53.102 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jul 13 01:46:52 smithi103 systemd[1]: Failed to start Ceph osd.7 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:46:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:53 smithi137 bash[27262]: cluster 1689212811.30041 mgr.a (mgr.14152) 547 : cluster 0 pgmap v442: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:53 smithi137 bash[27262]: audit 1689212812.260789 mon.d (mon.3) 6 : audit 0 from='client.? 172.21.15.137:0/1883561320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:46:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:53 smithi022 bash[26979]: cluster 1689212811.30041 mgr.a (mgr.14152) 547 : cluster 0 pgmap v442: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:53.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:53 smithi022 bash[26979]: audit 1689212812.260789 mon.d (mon.3) 6 : audit 0 from='client.? 172.21.15.137:0/1883561320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:46:53.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:53 smithi154 bash[27744]: cluster 1689212811.30041 mgr.a (mgr.14152) 547 : cluster 0 pgmap v442: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:53.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:53 smithi154 bash[27744]: audit 1689212812.260789 mon.d (mon.3) 6 : audit 0 from='client.? 172.21.15.137:0/1883561320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:46:53.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:53 smithi103 bash[27315]: cluster 1689212811.30041 mgr.a (mgr.14152) 547 : cluster 0 pgmap v442: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:53.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:53 smithi103 bash[27315]: audit 1689212812.260789 mon.d (mon.3) 6 : audit 0 from='client.? 172.21.15.137:0/1883561320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:46:53.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:53 smithi084 bash[27323]: cluster 1689212811.30041 mgr.a (mgr.14152) 547 : cluster 0 pgmap v442: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:53.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:53 smithi084 bash[27323]: audit 1689212812.260789 mon.d (mon.3) 6 : audit 0 from='client.? 172.21.15.137:0/1883561320' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:46:54.301 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:46:54 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:46:55.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:55 smithi137 bash[27262]: cluster 1689212813.3008485 mgr.a (mgr.14152) 548 : cluster 0 pgmap v443: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:55.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:55 smithi022 bash[26979]: cluster 1689212813.3008485 mgr.a (mgr.14152) 548 : cluster 0 pgmap v443: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:55.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:55 smithi154 bash[27744]: cluster 1689212813.3008485 mgr.a (mgr.14152) 548 : cluster 0 pgmap v443: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:55.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:55 smithi103 bash[27315]: cluster 1689212813.3008485 mgr.a (mgr.14152) 548 : cluster 0 pgmap v443: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:55.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:55 smithi084 bash[27323]: cluster 1689212813.3008485 mgr.a (mgr.14152) 548 : cluster 0 pgmap v443: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:57.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:57 smithi154 bash[27744]: cluster 1689212815.3013332 mgr.a (mgr.14152) 549 : cluster 0 pgmap v444: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:57.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:57 smithi137 bash[27262]: cluster 1689212815.3013332 mgr.a (mgr.14152) 549 : cluster 0 pgmap v444: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:57.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:57 smithi103 bash[27315]: cluster 1689212815.3013332 mgr.a (mgr.14152) 549 : cluster 0 pgmap v444: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:57.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:57 smithi084 bash[27323]: cluster 1689212815.3013332 mgr.a (mgr.14152) 549 : cluster 0 pgmap v444: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:57.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:57 smithi022 bash[26979]: cluster 1689212815.3013332 mgr.a (mgr.14152) 549 : cluster 0 pgmap v444: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:59.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:46:59 smithi154 bash[27744]: cluster 1689212817.3018942 mgr.a (mgr.14152) 550 : cluster 0 pgmap v445: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:59.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:46:59 smithi137 bash[27262]: cluster 1689212817.3018942 mgr.a (mgr.14152) 550 : cluster 0 pgmap v445: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:59.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:46:59 smithi103 bash[27315]: cluster 1689212817.3018942 mgr.a (mgr.14152) 550 : cluster 0 pgmap v445: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:59.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:46:59 smithi084 bash[27323]: cluster 1689212817.3018942 mgr.a (mgr.14152) 550 : cluster 0 pgmap v445: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:46:59.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:46:59 smithi022 bash[26979]: cluster 1689212817.3018942 mgr.a (mgr.14152) 550 : cluster 0 pgmap v445: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:01.428 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:01 smithi137 bash[27262]: cluster 1689212819.3024082 mgr.a (mgr.14152) 551 : cluster 0 pgmap v446: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:01.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:01 smithi154 bash[27744]: cluster 1689212819.3024082 mgr.a (mgr.14152) 551 : cluster 0 pgmap v446: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:01.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:01 smithi103 bash[27315]: cluster 1689212819.3024082 mgr.a (mgr.14152) 551 : cluster 0 pgmap v446: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:01.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:01 smithi084 bash[27323]: cluster 1689212819.3024082 mgr.a (mgr.14152) 551 : cluster 0 pgmap v446: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:01.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:01 smithi022 bash[26979]: cluster 1689212819.3024082 mgr.a (mgr.14152) 551 : cluster 0 pgmap v446: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:03.440 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:03 smithi137 bash[27262]: cluster 1689212821.3030143 mgr.a (mgr.14152) 552 : cluster 0 pgmap v447: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:03.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:03 smithi154 bash[27744]: cluster 1689212821.3030143 mgr.a (mgr.14152) 552 : cluster 0 pgmap v447: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:03.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:03 smithi103 bash[27315]: cluster 1689212821.3030143 mgr.a (mgr.14152) 552 : cluster 0 pgmap v447: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:03.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:03 smithi084 bash[27323]: cluster 1689212821.3030143 mgr.a (mgr.14152) 552 : cluster 0 pgmap v447: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:03.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:03 smithi022 bash[26979]: cluster 1689212821.3030143 mgr.a (mgr.14152) 552 : cluster 0 pgmap v447: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:04.450 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:04 smithi137 bash[27262]: audit 1689212824.1210065 mon.a (mon.0) 802 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-13T01:47:04.450 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:04 smithi137 bash[27262]: audit 1689212824.1230483 mon.a (mon.0) 803 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:04.450 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:04 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:47:04.451 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:04 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:04.451 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:04 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:04.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:04 smithi154 bash[27744]: audit 1689212824.1210065 mon.a (mon.0) 802 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-13T01:47:04.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:04 smithi154 bash[27744]: audit 1689212824.1230483 mon.a (mon.0) 803 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:04.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:04 smithi103 bash[27315]: audit 1689212824.1210065 mon.a (mon.0) 802 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-13T01:47:04.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:04 smithi103 bash[27315]: audit 1689212824.1230483 mon.a (mon.0) 803 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:04.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:04 smithi084 bash[27323]: audit 1689212824.1210065 mon.a (mon.0) 802 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-13T01:47:04.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:04 smithi084 bash[27323]: audit 1689212824.1230483 mon.a (mon.0) 803 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:04.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:04 smithi022 bash[26979]: audit 1689212824.1210065 mon.a (mon.0) 802 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-13T01:47:04.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:04 smithi022 bash[26979]: audit 1689212824.1230483 mon.a (mon.0) 803 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:05.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:05 smithi154 bash[27744]: cluster 1689212823.303611 mgr.a (mgr.14152) 553 : cluster 0 pgmap v448: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:05.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:05 smithi154 bash[27744]: cephadm 1689212824.1247313 mgr.a (mgr.14152) 554 : cephadm 1 Deploying daemon osd.10 on smithi137 2023-07-13T01:47:05.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:05 smithi137 bash[27262]: cluster 1689212823.303611 mgr.a (mgr.14152) 553 : cluster 0 pgmap v448: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:05.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:05 smithi137 bash[27262]: cephadm 1689212824.1247313 mgr.a (mgr.14152) 554 : cephadm 1 Deploying daemon osd.10 on smithi137 2023-07-13T01:47:05.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:05 smithi103 bash[27315]: cluster 1689212823.303611 mgr.a (mgr.14152) 553 : cluster 0 pgmap v448: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:05.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:05 smithi103 bash[27315]: cephadm 1689212824.1247313 mgr.a (mgr.14152) 554 : cephadm 1 Deploying daemon osd.10 on smithi137 2023-07-13T01:47:05.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:05 smithi084 bash[27323]: cluster 1689212823.303611 mgr.a (mgr.14152) 553 : cluster 0 pgmap v448: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:05.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:05 smithi084 bash[27323]: cephadm 1689212824.1247313 mgr.a (mgr.14152) 554 : cephadm 1 Deploying daemon osd.10 on smithi137 2023-07-13T01:47:05.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:05 smithi022 bash[26979]: cluster 1689212823.303611 mgr.a (mgr.14152) 553 : cluster 0 pgmap v448: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:05.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:05 smithi022 bash[26979]: cephadm 1689212824.1247313 mgr.a (mgr.14152) 554 : cephadm 1 Deploying daemon osd.10 on smithi137 2023-07-13T01:47:06.301 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:06 smithi137 bash[34880]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:06.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:06 smithi137 bash[34880]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:06.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:06 smithi137 bash[34880]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:47:06.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:06 smithi137 bash[34880]: --> Failed to activate any OSD(s) 2023-07-13T01:47:07.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:07 smithi137 bash[27262]: cluster 1689212825.304175 mgr.a (mgr.14152) 555 : cluster 0 pgmap v449: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:07.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:07 smithi154 bash[27744]: cluster 1689212825.304175 mgr.a (mgr.14152) 555 : cluster 0 pgmap v449: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:07.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:07 smithi103 bash[27315]: cluster 1689212825.304175 mgr.a (mgr.14152) 555 : cluster 0 pgmap v449: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:07.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:07 smithi084 bash[27323]: cluster 1689212825.304175 mgr.a (mgr.14152) 555 : cluster 0 pgmap v449: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:07.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:07 smithi022 bash[26979]: cluster 1689212825.304175 mgr.a (mgr.14152) 555 : cluster 0 pgmap v449: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:08.744 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:08 smithi137 bash[35126]: debug 2023-07-13T01:47:08.554+0000 7f2782a37700 1 -- 172.21.15.137:0/3691321910 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5639e3ba4d00 con 0x5639e3bfa800 2023-07-13T01:47:08.744 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:08 smithi137 bash[35126]: debug 2023-07-13T01:47:08.554+0000 7f278bbbc640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:47:09.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:09 smithi154 bash[27744]: cluster 1689212827.3046608 mgr.a (mgr.14152) 556 : cluster 0 pgmap v450: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:09.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:09 smithi137 bash[27262]: cluster 1689212827.3046608 mgr.a (mgr.14152) 556 : cluster 0 pgmap v450: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:09.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:09 smithi103 bash[27315]: cluster 1689212827.3046608 mgr.a (mgr.14152) 556 : cluster 0 pgmap v450: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:09.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:09 smithi084 bash[27323]: cluster 1689212827.3046608 mgr.a (mgr.14152) 556 : cluster 0 pgmap v450: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:09.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:09 smithi022 bash[26979]: cluster 1689212827.3046608 mgr.a (mgr.14152) 556 : cluster 0 pgmap v450: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:10.042 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:09 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:47:11.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:11 smithi154 bash[27744]: cluster 1689212829.3051348 mgr.a (mgr.14152) 557 : cluster 0 pgmap v451: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:11.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:11 smithi154 bash[27744]: audit 1689212830.5427244 mon.a (mon.0) 804 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:11 smithi154 bash[27744]: audit 1689212830.5503426 mon.a (mon.0) 805 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:11 smithi154 bash[27744]: audit 1689212830.5507793 mon.a (mon.0) 806 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:11.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:11 smithi137 bash[27262]: cluster 1689212829.3051348 mgr.a (mgr.14152) 557 : cluster 0 pgmap v451: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:11.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:11 smithi137 bash[27262]: audit 1689212830.5427244 mon.a (mon.0) 804 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:11 smithi137 bash[27262]: audit 1689212830.5503426 mon.a (mon.0) 805 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:11 smithi137 bash[27262]: audit 1689212830.5507793 mon.a (mon.0) 806 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:11.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:11 smithi103 bash[27315]: cluster 1689212829.3051348 mgr.a (mgr.14152) 557 : cluster 0 pgmap v451: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:11.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:11 smithi103 bash[27315]: audit 1689212830.5427244 mon.a (mon.0) 804 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:11 smithi103 bash[27315]: audit 1689212830.5503426 mon.a (mon.0) 805 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:11 smithi103 bash[27315]: audit 1689212830.5507793 mon.a (mon.0) 806 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:11.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:11 smithi084 bash[27323]: cluster 1689212829.3051348 mgr.a (mgr.14152) 557 : cluster 0 pgmap v451: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:11.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:11 smithi084 bash[27323]: audit 1689212830.5427244 mon.a (mon.0) 804 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:11 smithi084 bash[27323]: audit 1689212830.5503426 mon.a (mon.0) 805 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:11 smithi084 bash[27323]: audit 1689212830.5507793 mon.a (mon.0) 806 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:11.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:11 smithi022 bash[26979]: cluster 1689212829.3051348 mgr.a (mgr.14152) 557 : cluster 0 pgmap v451: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:11.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:11 smithi022 bash[26979]: audit 1689212830.5427244 mon.a (mon.0) 804 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:11 smithi022 bash[26979]: audit 1689212830.5503426 mon.a (mon.0) 805 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:11.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:11 smithi022 bash[26979]: audit 1689212830.5507793 mon.a (mon.0) 806 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:13.073 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:12 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:47:13.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:13 smithi154 bash[27744]: cluster 1689212831.3055992 mgr.a (mgr.14152) 558 : cluster 0 pgmap v452: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:13.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:13 smithi137 bash[27262]: cluster 1689212831.3055992 mgr.a (mgr.14152) 558 : cluster 0 pgmap v452: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:13.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:13 smithi103 bash[27315]: cluster 1689212831.3055992 mgr.a (mgr.14152) 558 : cluster 0 pgmap v452: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:13.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:13 smithi084 bash[27323]: cluster 1689212831.3055992 mgr.a (mgr.14152) 558 : cluster 0 pgmap v452: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:13.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:13 smithi022 bash[26979]: cluster 1689212831.3055992 mgr.a (mgr.14152) 558 : cluster 0 pgmap v452: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:15.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:15 smithi137 bash[27262]: cluster 1689212833.306175 mgr.a (mgr.14152) 559 : cluster 0 pgmap v453: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:15.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:15 smithi154 bash[27744]: cluster 1689212833.306175 mgr.a (mgr.14152) 559 : cluster 0 pgmap v453: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:15.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:15 smithi103 bash[27315]: cluster 1689212833.306175 mgr.a (mgr.14152) 559 : cluster 0 pgmap v453: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:15.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:15 smithi084 bash[27323]: cluster 1689212833.306175 mgr.a (mgr.14152) 559 : cluster 0 pgmap v453: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:15.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:15 smithi022 bash[26979]: cluster 1689212833.306175 mgr.a (mgr.14152) 559 : cluster 0 pgmap v453: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:16.845 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:16 smithi137 bash[27262]: cluster 1689212835.3068032 mgr.a (mgr.14152) 560 : cluster 0 pgmap v454: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:16.846 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:16 smithi137 bash[27262]: audit 1689212835.7946544 mon.a (mon.0) 807 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:16.846 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:16 smithi137 bash[27262]: audit 1689212835.801439 mon.a (mon.0) 808 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:16 smithi103 bash[27315]: cluster 1689212835.3068032 mgr.a (mgr.14152) 560 : cluster 0 pgmap v454: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:17.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:16 smithi103 bash[27315]: audit 1689212835.7946544 mon.a (mon.0) 807 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:16 smithi103 bash[27315]: audit 1689212835.801439 mon.a (mon.0) 808 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:16 smithi084 bash[27323]: cluster 1689212835.3068032 mgr.a (mgr.14152) 560 : cluster 0 pgmap v454: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:17.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:16 smithi084 bash[27323]: audit 1689212835.7946544 mon.a (mon.0) 807 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:16 smithi084 bash[27323]: audit 1689212835.801439 mon.a (mon.0) 808 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:16 smithi022 bash[26979]: cluster 1689212835.3068032 mgr.a (mgr.14152) 560 : cluster 0 pgmap v454: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:17.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:16 smithi022 bash[26979]: audit 1689212835.7946544 mon.a (mon.0) 807 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:16 smithi022 bash[26979]: audit 1689212835.801439 mon.a (mon.0) 808 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:16 smithi154 bash[27744]: cluster 1689212835.3068032 mgr.a (mgr.14152) 560 : cluster 0 pgmap v454: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:17.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:16 smithi154 bash[27744]: audit 1689212835.7946544 mon.a (mon.0) 807 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:17.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:16 smithi154 bash[27744]: audit 1689212835.801439 mon.a (mon.0) 808 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: audit 1689212837.298667 mon.a (mon.0) 809 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: audit 1689212837.3055708 mon.a (mon.0) 810 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: audit 1689212837.3069668 mon.a (mon.0) 811 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:18.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: cluster 1689212837.3073084 mgr.a (mgr.14152) 561 : cluster 0 pgmap v455: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: audit 1689212837.3089237 mon.a (mon.0) 812 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:18.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: cluster 1689212837.3115232 mgr.a (mgr.14152) 562 : cluster 0 pgmap v456: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: cluster 1689212837.3116992 mgr.a (mgr.14152) 563 : cluster 0 pgmap v457: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:18 smithi137 bash[27262]: audit 1689212837.3181474 mon.a (mon.0) 813 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: audit 1689212837.298667 mon.a (mon.0) 809 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: audit 1689212837.3055708 mon.a (mon.0) 810 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: audit 1689212837.3069668 mon.a (mon.0) 811 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:18.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: cluster 1689212837.3073084 mgr.a (mgr.14152) 561 : cluster 0 pgmap v455: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: audit 1689212837.3089237 mon.a (mon.0) 812 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:18.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: cluster 1689212837.3115232 mgr.a (mgr.14152) 562 : cluster 0 pgmap v456: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: cluster 1689212837.3116992 mgr.a (mgr.14152) 563 : cluster 0 pgmap v457: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:18 smithi103 bash[27315]: audit 1689212837.3181474 mon.a (mon.0) 813 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: audit 1689212837.298667 mon.a (mon.0) 809 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: audit 1689212837.3055708 mon.a (mon.0) 810 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: audit 1689212837.3069668 mon.a (mon.0) 811 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:18.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: cluster 1689212837.3073084 mgr.a (mgr.14152) 561 : cluster 0 pgmap v455: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: audit 1689212837.3089237 mon.a (mon.0) 812 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:18.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: cluster 1689212837.3115232 mgr.a (mgr.14152) 562 : cluster 0 pgmap v456: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: cluster 1689212837.3116992 mgr.a (mgr.14152) 563 : cluster 0 pgmap v457: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:18 smithi084 bash[27323]: audit 1689212837.3181474 mon.a (mon.0) 813 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: audit 1689212837.298667 mon.a (mon.0) 809 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: audit 1689212837.3055708 mon.a (mon.0) 810 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: audit 1689212837.3069668 mon.a (mon.0) 811 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:18.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: cluster 1689212837.3073084 mgr.a (mgr.14152) 561 : cluster 0 pgmap v455: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: audit 1689212837.3089237 mon.a (mon.0) 812 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:18.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: cluster 1689212837.3115232 mgr.a (mgr.14152) 562 : cluster 0 pgmap v456: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: cluster 1689212837.3116992 mgr.a (mgr.14152) 563 : cluster 0 pgmap v457: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:18 smithi022 bash[26979]: audit 1689212837.3181474 mon.a (mon.0) 813 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: audit 1689212837.298667 mon.a (mon.0) 809 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: audit 1689212837.3055708 mon.a (mon.0) 810 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:18.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: audit 1689212837.3069668 mon.a (mon.0) 811 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:18.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: cluster 1689212837.3073084 mgr.a (mgr.14152) 561 : cluster 0 pgmap v455: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: audit 1689212837.3089237 mon.a (mon.0) 812 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:18.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: cluster 1689212837.3115232 mgr.a (mgr.14152) 562 : cluster 0 pgmap v456: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: cluster 1689212837.3116992 mgr.a (mgr.14152) 563 : cluster 0 pgmap v457: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:18.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:18 smithi154 bash[27744]: audit 1689212837.3181474 mon.a (mon.0) 813 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:19.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:19 smithi137 bash[27262]: cluster 1689212838.3036466 mon.a (mon.0) 814 : cluster 3 Health check update: 10 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:47:19.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:19 smithi103 bash[27315]: cluster 1689212838.3036466 mon.a (mon.0) 814 : cluster 3 Health check update: 10 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:47:19.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:19 smithi084 bash[27323]: cluster 1689212838.3036466 mon.a (mon.0) 814 : cluster 3 Health check update: 10 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:47:19.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:19 smithi022 bash[26979]: cluster 1689212838.3036466 mon.a (mon.0) 814 : cluster 3 Health check update: 10 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:47:19.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:19 smithi154 bash[27744]: cluster 1689212838.3036466 mon.a (mon.0) 814 : cluster 3 Health check update: 10 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:47:20.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:20 smithi137 bash[27262]: cluster 1689212839.3120978 mgr.a (mgr.14152) 564 : cluster 0 pgmap v458: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:21.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:20 smithi154 bash[27744]: cluster 1689212839.3120978 mgr.a (mgr.14152) 564 : cluster 0 pgmap v458: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:21.084 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 10 on host 'smithi137' 2023-07-13T01:47:21.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:20 smithi103 bash[27315]: cluster 1689212839.3120978 mgr.a (mgr.14152) 564 : cluster 0 pgmap v458: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:21.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:20 smithi084 bash[27323]: cluster 1689212839.3120978 mgr.a (mgr.14152) 564 : cluster 0 pgmap v458: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:21.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:20 smithi022 bash[26979]: cluster 1689212839.3120978 mgr.a (mgr.14152) 564 : cluster 0 pgmap v458: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:21.753 DEBUG:teuthology.orchestra.run.smithi137:osd.10> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service 2023-07-13T01:47:21.755 INFO:tasks.cephadm:Deploying osd.11 on smithi137 with /dev/vg_nvme/lv_2... 2023-07-13T01:47:21.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-13T01:47:21.866 INFO:journalctl@ceph.osd.10.smithi137.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:47:22.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:22 smithi137 bash[27262]: audit 1689212841.0368593 mon.a (mon.0) 815 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:22 smithi137 bash[27262]: audit 1689212841.0443258 mon.a (mon.0) 816 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:22 smithi137 bash[27262]: audit 1689212841.0604572 mon.a (mon.0) 817 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:22.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:22 smithi103 bash[27315]: audit 1689212841.0368593 mon.a (mon.0) 815 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:22 smithi103 bash[27315]: audit 1689212841.0443258 mon.a (mon.0) 816 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:22 smithi103 bash[27315]: audit 1689212841.0604572 mon.a (mon.0) 817 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:22.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:22 smithi084 bash[27323]: audit 1689212841.0368593 mon.a (mon.0) 815 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:22 smithi084 bash[27323]: audit 1689212841.0443258 mon.a (mon.0) 816 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:22 smithi084 bash[27323]: audit 1689212841.0604572 mon.a (mon.0) 817 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:22.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:22 smithi022 bash[26979]: audit 1689212841.0368593 mon.a (mon.0) 815 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:22 smithi022 bash[26979]: audit 1689212841.0443258 mon.a (mon.0) 816 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:22 smithi022 bash[26979]: audit 1689212841.0604572 mon.a (mon.0) 817 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:22.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:22 smithi154 bash[27744]: audit 1689212841.0368593 mon.a (mon.0) 815 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:22 smithi154 bash[27744]: audit 1689212841.0443258 mon.a (mon.0) 816 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:22.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:22 smithi154 bash[27744]: audit 1689212841.0604572 mon.a (mon.0) 817 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:47:23.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:23 smithi137 bash[27262]: cluster 1689212841.3125424 mgr.a (mgr.14152) 565 : cluster 0 pgmap v459: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:23.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:23 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:47:23.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:23 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:23.302 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:23 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:23.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:23 smithi103 bash[27315]: cluster 1689212841.3125424 mgr.a (mgr.14152) 565 : cluster 0 pgmap v459: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:23.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:23 smithi084 bash[27323]: cluster 1689212841.3125424 mgr.a (mgr.14152) 565 : cluster 0 pgmap v459: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:23.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:23 smithi022 bash[26979]: cluster 1689212841.3125424 mgr.a (mgr.14152) 565 : cluster 0 pgmap v459: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:23.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:23 smithi154 bash[27744]: cluster 1689212841.3125424 mgr.a (mgr.14152) 565 : cluster 0 pgmap v459: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:24.701 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:24 smithi137 bash[36400]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:24.702 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:24 smithi137 bash[36400]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:24.702 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:24 smithi137 bash[36400]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:47:24.702 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:24 smithi137 bash[36400]: --> Failed to activate any OSD(s) 2023-07-13T01:47:25.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:25 smithi137 bash[27262]: cluster 1689212843.313046 mgr.a (mgr.14152) 566 : cluster 0 pgmap v460: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:25.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:25 smithi103 bash[27315]: cluster 1689212843.313046 mgr.a (mgr.14152) 566 : cluster 0 pgmap v460: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:25.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:25 smithi084 bash[27323]: cluster 1689212843.313046 mgr.a (mgr.14152) 566 : cluster 0 pgmap v460: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:25.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:25 smithi022 bash[26979]: cluster 1689212843.313046 mgr.a (mgr.14152) 566 : cluster 0 pgmap v460: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:25.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:25 smithi154 bash[27744]: cluster 1689212843.313046 mgr.a (mgr.14152) 566 : cluster 0 pgmap v460: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:26.483 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:26 smithi137 bash[36540]: debug 2023-07-13T01:47:26.277+0000 7f4c81079700 1 -- 172.21.15.137:0/2270784756 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ddadce0d00 con 0x55ddadd36c00 2023-07-13T01:47:26.484 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:26 smithi137 bash[36540]: debug 2023-07-13T01:47:26.277+0000 7f4c8a1fe640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:47:26.675 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.d/config 2023-07-13T01:47:27.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:27 smithi137 bash[27262]: cluster 1689212845.3135123 mgr.a (mgr.14152) 567 : cluster 0 pgmap v461: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:27.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:27 smithi103 bash[27315]: cluster 1689212845.3135123 mgr.a (mgr.14152) 567 : cluster 0 pgmap v461: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:27.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:27 smithi084 bash[27323]: cluster 1689212845.3135123 mgr.a (mgr.14152) 567 : cluster 0 pgmap v461: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:27.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:27 smithi022 bash[26979]: cluster 1689212845.3135123 mgr.a (mgr.14152) 567 : cluster 0 pgmap v461: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:27.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:27 smithi154 bash[27744]: cluster 1689212845.3135123 mgr.a (mgr.14152) 567 : cluster 0 pgmap v461: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:27.890 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:27 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:47:28.104 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:27 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:47:28.105 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:27 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:28.105 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:27 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:29.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:29 smithi137 bash[27262]: cluster 1689212847.3139744 mgr.a (mgr.14152) 568 : cluster 0 pgmap v462: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:29.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:29 smithi103 bash[27315]: cluster 1689212847.3139744 mgr.a (mgr.14152) 568 : cluster 0 pgmap v462: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:29.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:29 smithi084 bash[27323]: cluster 1689212847.3139744 mgr.a (mgr.14152) 568 : cluster 0 pgmap v462: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:29.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:29 smithi022 bash[26979]: cluster 1689212847.3139744 mgr.a (mgr.14152) 568 : cluster 0 pgmap v462: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:29.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:29 smithi154 bash[27744]: cluster 1689212847.3139744 mgr.a (mgr.14152) 568 : cluster 0 pgmap v462: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:30.301 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:30 smithi137 bash[36746]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:30.301 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:30 smithi137 bash[36746]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:30.302 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:30 smithi137 bash[36746]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:47:30.302 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:30 smithi137 bash[36746]: --> Failed to activate any OSD(s) 2023-07-13T01:47:31.175 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:31 smithi137 bash[27262]: cluster 1689212849.3144677 mgr.a (mgr.14152) 569 : cluster 0 pgmap v463: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:31.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:31 smithi103 bash[27315]: cluster 1689212849.3144677 mgr.a (mgr.14152) 569 : cluster 0 pgmap v463: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:31.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:31 smithi084 bash[27323]: cluster 1689212849.3144677 mgr.a (mgr.14152) 569 : cluster 0 pgmap v463: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:31.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:31 smithi022 bash[26979]: cluster 1689212849.3144677 mgr.a (mgr.14152) 569 : cluster 0 pgmap v463: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:31.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:31 smithi154 bash[27744]: cluster 1689212849.3144677 mgr.a (mgr.14152) 569 : cluster 0 pgmap v463: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:32.551 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:32 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:47:33.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:33 smithi103 bash[27315]: cluster 1689212851.314956 mgr.a (mgr.14152) 570 : cluster 0 pgmap v464: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:33.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:33 smithi084 bash[27323]: cluster 1689212851.314956 mgr.a (mgr.14152) 570 : cluster 0 pgmap v464: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:33.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:33 smithi022 bash[26979]: cluster 1689212851.314956 mgr.a (mgr.14152) 570 : cluster 0 pgmap v464: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:33.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:33 smithi154 bash[27744]: cluster 1689212851.314956 mgr.a (mgr.14152) 570 : cluster 0 pgmap v464: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:33.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:33 smithi137 bash[27262]: cluster 1689212851.314956 mgr.a (mgr.14152) 570 : cluster 0 pgmap v464: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:34.165 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:33 smithi137 bash[37087]: debug 2023-07-13T01:47:33.957+0000 7f80eaf03700 1 -- 172.21.15.137:0/689696320 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55abcf31cd00 con 0x55abcf372800 2023-07-13T01:47:34.166 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:33 smithi137 bash[37087]: debug 2023-07-13T01:47:33.957+0000 7f80f4088640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:47:34.347 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-13T01:47:34.347 INFO:teuthology.orchestra.run.smithi137.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-13T01:47:34.347 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10+0 records in 2023-07-13T01:47:34.347 INFO:teuthology.orchestra.run.smithi137.stderr:10+0 records out 2023-07-13T01:47:34.347 INFO:teuthology.orchestra.run.smithi137.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0146634 s, 715 MB/s 2023-07-13T01:47:34.348 INFO:teuthology.orchestra.run.smithi137.stderr:--> Zapping successful for: 2023-07-13T01:47:35.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:35 smithi103 bash[27315]: cluster 1689212853.3154087 mgr.a (mgr.14152) 571 : cluster 0 pgmap v465: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:35.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:35 smithi084 bash[27323]: cluster 1689212853.3154087 mgr.a (mgr.14152) 571 : cluster 0 pgmap v465: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:35.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:35 smithi022 bash[26979]: cluster 1689212853.3154087 mgr.a (mgr.14152) 571 : cluster 0 pgmap v465: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:35.407 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:35 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:47:35.408 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:35 smithi137 bash[27262]: cluster 1689212853.3154087 mgr.a (mgr.14152) 571 : cluster 0 pgmap v465: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:35.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:35 smithi154 bash[27744]: cluster 1689212853.3154087 mgr.a (mgr.14152) 571 : cluster 0 pgmap v465: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:35.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi137:vg_nvme/lv_2 2023-07-13T01:47:37.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: cluster 1689212855.3159244 mgr.a (mgr.14152) 572 : cluster 0 pgmap v466: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: cephadm 1689212856.1904693 mgr.a (mgr.14152) 573 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:47:37.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.200281 mon.a (mon.0) 818 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.2082598 mon.a (mon.0) 819 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.2095914 mon.a (mon.0) 820 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.2110162 mon.a (mon.0) 821 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: cephadm 1689212856.2120934 mgr.a (mgr.14152) 574 : cephadm 1 Adjusting osd_memory_target on smithi137 to 8632M 2023-07-13T01:47:37.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.218871 mon.a (mon.0) 822 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.2206686 mon.a (mon.0) 823 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:37.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.2219698 mon.a (mon.0) 824 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:37.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: cluster 1689212856.2246487 mgr.a (mgr.14152) 575 : cluster 0 pgmap v467: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: cluster 1689212856.2248378 mgr.a (mgr.14152) 576 : cluster 0 pgmap v468: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.504 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:37 smithi154 bash[27744]: audit 1689212856.2323654 mon.a (mon.0) 825 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: cluster 1689212855.3159244 mgr.a (mgr.14152) 572 : cluster 0 pgmap v466: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: cephadm 1689212856.1904693 mgr.a (mgr.14152) 573 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:47:37.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.200281 mon.a (mon.0) 818 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.2082598 mon.a (mon.0) 819 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.2095914 mon.a (mon.0) 820 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.2110162 mon.a (mon.0) 821 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: cephadm 1689212856.2120934 mgr.a (mgr.14152) 574 : cephadm 1 Adjusting osd_memory_target on smithi137 to 8632M 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.218871 mon.a (mon.0) 822 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.2206686 mon.a (mon.0) 823 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.2219698 mon.a (mon.0) 824 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: cluster 1689212856.2246487 mgr.a (mgr.14152) 575 : cluster 0 pgmap v467: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: cluster 1689212856.2248378 mgr.a (mgr.14152) 576 : cluster 0 pgmap v468: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:37 smithi137 bash[27262]: audit 1689212856.2323654 mon.a (mon.0) 825 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: cluster 1689212855.3159244 mgr.a (mgr.14152) 572 : cluster 0 pgmap v466: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: cephadm 1689212856.1904693 mgr.a (mgr.14152) 573 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.200281 mon.a (mon.0) 818 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.2082598 mon.a (mon.0) 819 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.2095914 mon.a (mon.0) 820 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.2110162 mon.a (mon.0) 821 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: cephadm 1689212856.2120934 mgr.a (mgr.14152) 574 : cephadm 1 Adjusting osd_memory_target on smithi137 to 8632M 2023-07-13T01:47:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.218871 mon.a (mon.0) 822 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.2206686 mon.a (mon.0) 823 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:37.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.2219698 mon.a (mon.0) 824 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:37.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: cluster 1689212856.2246487 mgr.a (mgr.14152) 575 : cluster 0 pgmap v467: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: cluster 1689212856.2248378 mgr.a (mgr.14152) 576 : cluster 0 pgmap v468: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:37 smithi103 bash[27315]: audit 1689212856.2323654 mon.a (mon.0) 825 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: cluster 1689212855.3159244 mgr.a (mgr.14152) 572 : cluster 0 pgmap v466: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: cephadm 1689212856.1904693 mgr.a (mgr.14152) 573 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:47:37.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.200281 mon.a (mon.0) 818 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.2082598 mon.a (mon.0) 819 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.2095914 mon.a (mon.0) 820 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.2110162 mon.a (mon.0) 821 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: cephadm 1689212856.2120934 mgr.a (mgr.14152) 574 : cephadm 1 Adjusting osd_memory_target on smithi137 to 8632M 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.218871 mon.a (mon.0) 822 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.2206686 mon.a (mon.0) 823 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.2219698 mon.a (mon.0) 824 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: cluster 1689212856.2246487 mgr.a (mgr.14152) 575 : cluster 0 pgmap v467: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: cluster 1689212856.2248378 mgr.a (mgr.14152) 576 : cluster 0 pgmap v468: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:37 smithi084 bash[27323]: audit 1689212856.2323654 mon.a (mon.0) 825 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: cluster 1689212855.3159244 mgr.a (mgr.14152) 572 : cluster 0 pgmap v466: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: cephadm 1689212856.1904693 mgr.a (mgr.14152) 573 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:47:37.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.200281 mon.a (mon.0) 818 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.2082598 mon.a (mon.0) 819 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.2095914 mon.a (mon.0) 820 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.2110162 mon.a (mon.0) 821 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: cephadm 1689212856.2120934 mgr.a (mgr.14152) 574 : cephadm 1 Adjusting osd_memory_target on smithi137 to 8632M 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.218871 mon.a (mon.0) 822 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.2206686 mon.a (mon.0) 823 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.2219698 mon.a (mon.0) 824 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: cluster 1689212856.2246487 mgr.a (mgr.14152) 575 : cluster 0 pgmap v467: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: cluster 1689212856.2248378 mgr.a (mgr.14152) 576 : cluster 0 pgmap v468: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:37 smithi022 bash[26979]: audit 1689212856.2323654 mon.a (mon.0) 825 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:47:38.300 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:37 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:47:38.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:38 smithi137 bash[27262]: cluster 1689212858.225356 mgr.a (mgr.14152) 577 : cluster 0 pgmap v469: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:38.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:38 smithi103 bash[27315]: cluster 1689212858.225356 mgr.a (mgr.14152) 577 : cluster 0 pgmap v469: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:38.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:38 smithi084 bash[27323]: cluster 1689212858.225356 mgr.a (mgr.14152) 577 : cluster 0 pgmap v469: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:38.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:38 smithi022 bash[26979]: cluster 1689212858.225356 mgr.a (mgr.14152) 577 : cluster 0 pgmap v469: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:38.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:38 smithi154 bash[27744]: cluster 1689212858.225356 mgr.a (mgr.14152) 577 : cluster 0 pgmap v469: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:40.639 INFO:teuthology.orchestra.run.smithi137.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.d/config 2023-07-13T01:47:41.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:40 smithi154 bash[27744]: cluster 1689212860.22589 mgr.a (mgr.14152) 578 : cluster 0 pgmap v470: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:41.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:40 smithi137 bash[27262]: cluster 1689212860.22589 mgr.a (mgr.14152) 578 : cluster 0 pgmap v470: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:41.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:40 smithi103 bash[27315]: cluster 1689212860.22589 mgr.a (mgr.14152) 578 : cluster 0 pgmap v470: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:41.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:40 smithi084 bash[27323]: cluster 1689212860.22589 mgr.a (mgr.14152) 578 : cluster 0 pgmap v470: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:41.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:40 smithi022 bash[26979]: cluster 1689212860.22589 mgr.a (mgr.14152) 578 : cluster 0 pgmap v470: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:42.588 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:42 smithi137 bash[27262]: cluster 1689212862.2263892 mgr.a (mgr.14152) 579 : cluster 0 pgmap v471: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:42.589 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:42 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:47:42.589 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:42 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:42.589 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:42 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:42.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:42 smithi103 bash[27315]: cluster 1689212862.2263892 mgr.a (mgr.14152) 579 : cluster 0 pgmap v471: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:42.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:42 smithi084 bash[27323]: cluster 1689212862.2263892 mgr.a (mgr.14152) 579 : cluster 0 pgmap v471: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:42.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:42 smithi022 bash[26979]: cluster 1689212862.2263892 mgr.a (mgr.14152) 579 : cluster 0 pgmap v471: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:42.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:42 smithi154 bash[27744]: cluster 1689212862.2263892 mgr.a (mgr.14152) 579 : cluster 0 pgmap v471: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:44.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:44 smithi103 bash[27315]: cluster 1689212864.226844 mgr.a (mgr.14152) 580 : cluster 0 pgmap v472: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:44.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:44 smithi084 bash[27323]: cluster 1689212864.226844 mgr.a (mgr.14152) 580 : cluster 0 pgmap v472: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:44.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:44 smithi022 bash[26979]: cluster 1689212864.226844 mgr.a (mgr.14152) 580 : cluster 0 pgmap v472: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:44.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:44 smithi154 bash[27744]: cluster 1689212864.226844 mgr.a (mgr.14152) 580 : cluster 0 pgmap v472: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:44.800 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:44 smithi137 bash[38267]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:44.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:44 smithi137 bash[38267]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:44.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:44 smithi137 bash[38267]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:47:44.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:44 smithi137 bash[38267]: --> Failed to activate any OSD(s) 2023-07-13T01:47:44.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:44 smithi137 bash[27262]: cluster 1689212864.226844 mgr.a (mgr.14152) 580 : cluster 0 pgmap v472: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:45.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:45 smithi137 bash[27262]: audit 1689212864.4591906 mgr.a (mgr.14152) 581 : audit 0 from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:47:45.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:45 smithi137 bash[27262]: audit 1689212864.4663897 mon.a (mon.0) 826 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:47:45.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:45 smithi137 bash[27262]: audit 1689212864.4736123 mon.a (mon.0) 827 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:47:45.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:45 smithi137 bash[27262]: audit 1689212864.4749427 mon.a (mon.0) 828 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:45.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:45 smithi103 bash[27315]: audit 1689212864.4591906 mgr.a (mgr.14152) 581 : audit 0 from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:47:45.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:45 smithi103 bash[27315]: audit 1689212864.4663897 mon.a (mon.0) 826 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:47:45.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:45 smithi103 bash[27315]: audit 1689212864.4736123 mon.a (mon.0) 827 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:47:45.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:45 smithi103 bash[27315]: audit 1689212864.4749427 mon.a (mon.0) 828 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:45.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:45 smithi084 bash[27323]: audit 1689212864.4591906 mgr.a (mgr.14152) 581 : audit 0 from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:47:45.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:45 smithi084 bash[27323]: audit 1689212864.4663897 mon.a (mon.0) 826 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:47:45.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:45 smithi084 bash[27323]: audit 1689212864.4736123 mon.a (mon.0) 827 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:47:45.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:45 smithi084 bash[27323]: audit 1689212864.4749427 mon.a (mon.0) 828 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:45.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:45 smithi022 bash[26979]: audit 1689212864.4591906 mgr.a (mgr.14152) 581 : audit 0 from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:47:45.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:45 smithi022 bash[26979]: audit 1689212864.4663897 mon.a (mon.0) 826 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:47:45.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:45 smithi022 bash[26979]: audit 1689212864.4736123 mon.a (mon.0) 827 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:47:45.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:45 smithi022 bash[26979]: audit 1689212864.4749427 mon.a (mon.0) 828 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:45.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:45 smithi154 bash[27744]: audit 1689212864.4591906 mgr.a (mgr.14152) 581 : audit 0 from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi137:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:47:45.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:45 smithi154 bash[27744]: audit 1689212864.4663897 mon.a (mon.0) 826 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:47:45.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:45 smithi154 bash[27744]: audit 1689212864.4736123 mon.a (mon.0) 827 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:47:45.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:45 smithi154 bash[27744]: audit 1689212864.4749427 mon.a (mon.0) 828 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:47:46.300 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:46 smithi137 bash[38477]: debug 2023-07-13T01:47:46.117+0000 7f5a4f5bf700 1 -- 172.21.15.137:0/469859355 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e51184d00 con 0x560e511da800 2023-07-13T01:47:46.301 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:46 smithi137 bash[38477]: debug 2023-07-13T01:47:46.121+0000 7f5a58744640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:47:46.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:46 smithi103 bash[27315]: cluster 1689212866.2274022 mgr.a (mgr.14152) 582 : cluster 0 pgmap v473: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:46.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:46 smithi084 bash[27323]: cluster 1689212866.2274022 mgr.a (mgr.14152) 582 : cluster 0 pgmap v473: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:46.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:46 smithi022 bash[26979]: cluster 1689212866.2274022 mgr.a (mgr.14152) 582 : cluster 0 pgmap v473: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:46.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:46 smithi154 bash[27744]: cluster 1689212866.2274022 mgr.a (mgr.14152) 582 : cluster 0 pgmap v473: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:46.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:46 smithi137 bash[27262]: cluster 1689212866.2274022 mgr.a (mgr.14152) 582 : cluster 0 pgmap v473: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:47.300 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:46 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:47:48.303 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:48 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:47:48.303 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:48 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:48.304 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:48 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:48.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:48 smithi137 bash[27262]: cluster 1689212868.2279162 mgr.a (mgr.14152) 583 : cluster 0 pgmap v474: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:48.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:48 smithi103 bash[27315]: cluster 1689212868.2279162 mgr.a (mgr.14152) 583 : cluster 0 pgmap v474: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:48.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:48 smithi084 bash[27323]: cluster 1689212868.2279162 mgr.a (mgr.14152) 583 : cluster 0 pgmap v474: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:48.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:48 smithi022 bash[26979]: cluster 1689212868.2279162 mgr.a (mgr.14152) 583 : cluster 0 pgmap v474: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:48.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:48 smithi154 bash[27744]: cluster 1689212868.2279162 mgr.a (mgr.14152) 583 : cluster 0 pgmap v474: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:49.550 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:49 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:47:50.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: cluster 1689212869.6914806 mon.a (mon.0) 829 : cluster 1 Marking osd.1 out (has been down for 604 seconds) 2023-07-13T01:47:50.034 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: cluster 1689212869.701914 mon.a (mon.0) 830 : cluster 0 osdmap e17: 11 total, 0 up, 9 in 2023-07-13T01:47:50.035 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7025125 mon.a (mon.0) 831 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:50.035 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7028234 mon.a (mon.0) 832 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:50.035 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7030482 mon.a (mon.0) 833 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:50.036 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7033186 mon.a (mon.0) 834 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:50.036 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.703565 mon.a (mon.0) 835 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:50.036 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.703815 mon.a (mon.0) 836 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:50.036 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7085764 mon.a (mon.0) 837 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:50.037 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.708885 mon.a (mon.0) 838 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:50.037 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7091572 mon.a (mon.0) 839 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:50.037 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.709389 mon.a (mon.0) 840 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:50.037 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:49 smithi154 bash[27744]: audit 1689212869.7095988 mon.a (mon.0) 841 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:50.050 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[38727]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:50.051 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[38727]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:47:50.051 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[38727]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:47:50.051 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[38727]: --> Failed to activate any OSD(s) 2023-07-13T01:47:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: cluster 1689212869.6914806 mon.a (mon.0) 829 : cluster 1 Marking osd.1 out (has been down for 604 seconds) 2023-07-13T01:47:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: cluster 1689212869.701914 mon.a (mon.0) 830 : cluster 0 osdmap e17: 11 total, 0 up, 9 in 2023-07-13T01:47:50.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7025125 mon.a (mon.0) 831 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7028234 mon.a (mon.0) 832 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7030482 mon.a (mon.0) 833 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7033186 mon.a (mon.0) 834 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:50.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.703565 mon.a (mon.0) 835 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.703815 mon.a (mon.0) 836 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7085764 mon.a (mon.0) 837 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.708885 mon.a (mon.0) 838 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7091572 mon.a (mon.0) 839 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.709389 mon.a (mon.0) 840 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:50.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:49 smithi137 bash[27262]: audit 1689212869.7095988 mon.a (mon.0) 841 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:50.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: cluster 1689212869.6914806 mon.a (mon.0) 829 : cluster 1 Marking osd.1 out (has been down for 604 seconds) 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: cluster 1689212869.701914 mon.a (mon.0) 830 : cluster 0 osdmap e17: 11 total, 0 up, 9 in 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7025125 mon.a (mon.0) 831 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7028234 mon.a (mon.0) 832 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7030482 mon.a (mon.0) 833 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7033186 mon.a (mon.0) 834 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.703565 mon.a (mon.0) 835 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:50.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.703815 mon.a (mon.0) 836 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7085764 mon.a (mon.0) 837 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.708885 mon.a (mon.0) 838 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7091572 mon.a (mon.0) 839 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.709389 mon.a (mon.0) 840 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:50.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:49 smithi103 bash[27315]: audit 1689212869.7095988 mon.a (mon.0) 841 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:50.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: cluster 1689212869.6914806 mon.a (mon.0) 829 : cluster 1 Marking osd.1 out (has been down for 604 seconds) 2023-07-13T01:47:50.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: cluster 1689212869.701914 mon.a (mon.0) 830 : cluster 0 osdmap e17: 11 total, 0 up, 9 in 2023-07-13T01:47:50.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7025125 mon.a (mon.0) 831 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7028234 mon.a (mon.0) 832 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7030482 mon.a (mon.0) 833 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7033186 mon.a (mon.0) 834 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.703565 mon.a (mon.0) 835 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.703815 mon.a (mon.0) 836 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:50.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7085764 mon.a (mon.0) 837 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.708885 mon.a (mon.0) 838 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7091572 mon.a (mon.0) 839 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.709389 mon.a (mon.0) 840 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:50.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:49 smithi084 bash[27323]: audit 1689212869.7095988 mon.a (mon.0) 841 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:50.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: cluster 1689212869.6914806 mon.a (mon.0) 829 : cluster 1 Marking osd.1 out (has been down for 604 seconds) 2023-07-13T01:47:50.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: cluster 1689212869.701914 mon.a (mon.0) 830 : cluster 0 osdmap e17: 11 total, 0 up, 9 in 2023-07-13T01:47:50.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7025125 mon.a (mon.0) 831 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:50.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7028234 mon.a (mon.0) 832 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:50.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7030482 mon.a (mon.0) 833 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:50.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7033186 mon.a (mon.0) 834 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.703565 mon.a (mon.0) 835 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.703815 mon.a (mon.0) 836 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7085764 mon.a (mon.0) 837 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.708885 mon.a (mon.0) 838 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7091572 mon.a (mon.0) 839 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.709389 mon.a (mon.0) 840 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:50.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:49 smithi022 bash[26979]: audit 1689212869.7095988 mon.a (mon.0) 841 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:51.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:50 smithi154 bash[27744]: cluster 1689212870.2284076 mgr.a (mgr.14152) 584 : cluster 0 pgmap v476: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:51.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:50 smithi137 bash[27262]: cluster 1689212870.2284076 mgr.a (mgr.14152) 584 : cluster 0 pgmap v476: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:51.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:50 smithi103 bash[27315]: cluster 1689212870.2284076 mgr.a (mgr.14152) 584 : cluster 0 pgmap v476: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:51.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:50 smithi084 bash[27323]: cluster 1689212870.2284076 mgr.a (mgr.14152) 584 : cluster 0 pgmap v476: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:51.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:50 smithi022 bash[26979]: cluster 1689212870.2284076 mgr.a (mgr.14152) 584 : cluster 0 pgmap v476: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:52.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:52 smithi137 bash[27262]: cluster 1689212872.2288785 mgr.a (mgr.14152) 585 : cluster 0 pgmap v477: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:52.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:52 smithi103 bash[27315]: cluster 1689212872.2288785 mgr.a (mgr.14152) 585 : cluster 0 pgmap v477: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:52.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:52 smithi084 bash[27323]: cluster 1689212872.2288785 mgr.a (mgr.14152) 585 : cluster 0 pgmap v477: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:52.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:52 smithi022 bash[26979]: cluster 1689212872.2288785 mgr.a (mgr.14152) 585 : cluster 0 pgmap v477: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:52.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:52 smithi154 bash[27744]: cluster 1689212872.2288785 mgr.a (mgr.14152) 585 : cluster 0 pgmap v477: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:53.300 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:52 smithi137 bash[38865]: debug 2023-07-13T01:47:52.957+0000 7f25c5fcc700 1 -- 172.21.15.137:0/4275373144 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f062c8cd00 con 0x55f062ce3000 2023-07-13T01:47:53.300 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:52 smithi137 bash[38865]: debug 2023-07-13T01:47:52.961+0000 7f25cf151640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:47:54.300 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:54 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:47:54.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:54 smithi137 bash[27262]: cluster 1689212874.229362 mgr.a (mgr.14152) 586 : cluster 0 pgmap v478: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:54.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:54 smithi103 bash[27315]: cluster 1689212874.229362 mgr.a (mgr.14152) 586 : cluster 0 pgmap v478: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:54.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:54 smithi084 bash[27323]: cluster 1689212874.229362 mgr.a (mgr.14152) 586 : cluster 0 pgmap v478: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:54.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:54 smithi022 bash[26979]: cluster 1689212874.229362 mgr.a (mgr.14152) 586 : cluster 0 pgmap v478: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:54.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:54 smithi154 bash[27744]: cluster 1689212874.229362 mgr.a (mgr.14152) 586 : cluster 0 pgmap v478: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:55.944 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2687879 mon.a (mon.0) 842 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:55.945 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.270776 mon.d (mon.3) 7 : audit 1 from='client.? 172.21.15.137:0/3411048234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:55.945 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.279537 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]': finished 2023-07-13T01:47:55.946 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: cluster 1689212875.2796082 mon.a (mon.0) 844 : cluster 0 osdmap e18: 12 total, 0 up, 10 in 2023-07-13T01:47:55.946 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2797587 mon.a (mon.0) 845 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:55.946 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.280155 mon.a (mon.0) 846 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:55.947 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.280406 mon.a (mon.0) 847 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:55.947 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.280626 mon.a (mon.0) 848 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:55.947 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2808645 mon.a (mon.0) 849 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:55.947 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2810838 mon.a (mon.0) 850 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:55.948 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2813027 mon.a (mon.0) 851 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:55.948 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.281553 mon.a (mon.0) 852 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:55.948 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2817662 mon.a (mon.0) 853 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:55.949 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.282014 mon.a (mon.0) 854 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:55.949 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.282289 mon.a (mon.0) 855 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:55.949 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:55 smithi137 bash[27262]: audit 1689212875.2825413 mon.a (mon.0) 856 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:47:56.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2687879 mon.a (mon.0) 842 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.270776 mon.d (mon.3) 7 : audit 1 from='client.? 172.21.15.137:0/3411048234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.279537 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]': finished 2023-07-13T01:47:56.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: cluster 1689212875.2796082 mon.a (mon.0) 844 : cluster 0 osdmap e18: 12 total, 0 up, 10 in 2023-07-13T01:47:56.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2797587 mon.a (mon.0) 845 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:56.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.280155 mon.a (mon.0) 846 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.280406 mon.a (mon.0) 847 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.280626 mon.a (mon.0) 848 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2808645 mon.a (mon.0) 849 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2810838 mon.a (mon.0) 850 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2813027 mon.a (mon.0) 851 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.281553 mon.a (mon.0) 852 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:56.004 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2817662 mon.a (mon.0) 853 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:56.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.282014 mon.a (mon.0) 854 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:56.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.282289 mon.a (mon.0) 855 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:56.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:55 smithi154 bash[27744]: audit 1689212875.2825413 mon.a (mon.0) 856 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:47:56.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2687879 mon.a (mon.0) 842 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.270776 mon.d (mon.3) 7 : audit 1 from='client.? 172.21.15.137:0/3411048234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.279537 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]': finished 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: cluster 1689212875.2796082 mon.a (mon.0) 844 : cluster 0 osdmap e18: 12 total, 0 up, 10 in 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2797587 mon.a (mon.0) 845 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.280155 mon.a (mon.0) 846 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.280406 mon.a (mon.0) 847 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:56.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.280626 mon.a (mon.0) 848 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2808645 mon.a (mon.0) 849 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2810838 mon.a (mon.0) 850 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2813027 mon.a (mon.0) 851 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.281553 mon.a (mon.0) 852 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2817662 mon.a (mon.0) 853 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.282014 mon.a (mon.0) 854 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:56.102 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.282289 mon.a (mon.0) 855 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:56.103 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:55 smithi103 bash[27315]: audit 1689212875.2825413 mon.a (mon.0) 856 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:47:56.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2687879 mon.a (mon.0) 842 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.270776 mon.d (mon.3) 7 : audit 1 from='client.? 172.21.15.137:0/3411048234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.279537 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]': finished 2023-07-13T01:47:56.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: cluster 1689212875.2796082 mon.a (mon.0) 844 : cluster 0 osdmap e18: 12 total, 0 up, 10 in 2023-07-13T01:47:56.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2797587 mon.a (mon.0) 845 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.280155 mon.a (mon.0) 846 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.280406 mon.a (mon.0) 847 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.280626 mon.a (mon.0) 848 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2808645 mon.a (mon.0) 849 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:56.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2810838 mon.a (mon.0) 850 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:56.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2813027 mon.a (mon.0) 851 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:56.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.281553 mon.a (mon.0) 852 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:56.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2817662 mon.a (mon.0) 853 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:56.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.282014 mon.a (mon.0) 854 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:56.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.282289 mon.a (mon.0) 855 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:56.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:55 smithi084 bash[27323]: audit 1689212875.2825413 mon.a (mon.0) 856 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:47:56.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2687879 mon.a (mon.0) 842 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.270776 mon.d (mon.3) 7 : audit 1 from='client.? 172.21.15.137:0/3411048234' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]: dispatch 2023-07-13T01:47:56.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.279537 mon.a (mon.0) 843 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7826c42b-aa0f-454e-b904-2f9900a59f53"}]': finished 2023-07-13T01:47:56.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: cluster 1689212875.2796082 mon.a (mon.0) 844 : cluster 0 osdmap e18: 12 total, 0 up, 10 in 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2797587 mon.a (mon.0) 845 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.280155 mon.a (mon.0) 846 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.280406 mon.a (mon.0) 847 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.280626 mon.a (mon.0) 848 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2808645 mon.a (mon.0) 849 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2810838 mon.a (mon.0) 850 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:47:56.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2813027 mon.a (mon.0) 851 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:47:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.281553 mon.a (mon.0) 852 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:47:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2817662 mon.a (mon.0) 853 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:47:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.282014 mon.a (mon.0) 854 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:47:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.282289 mon.a (mon.0) 855 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:47:56.159 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:55 smithi022 bash[26979]: audit 1689212875.2825413 mon.a (mon.0) 856 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:47:56.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:56 smithi137 bash[27262]: audit 1689212876.0628657 mon.d (mon.3) 8 : audit 0 from='client.? 172.21.15.137:0/3852177793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:47:56.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:56 smithi137 bash[27262]: cluster 1689212876.2298443 mgr.a (mgr.14152) 587 : cluster 0 pgmap v480: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:56.801 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:47:56 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:47:57.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:56 smithi154 bash[27744]: audit 1689212876.0628657 mon.d (mon.3) 8 : audit 0 from='client.? 172.21.15.137:0/3852177793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:47:57.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:56 smithi154 bash[27744]: cluster 1689212876.2298443 mgr.a (mgr.14152) 587 : cluster 0 pgmap v480: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:56 smithi103 bash[27315]: audit 1689212876.0628657 mon.d (mon.3) 8 : audit 0 from='client.? 172.21.15.137:0/3852177793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:47:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:56 smithi103 bash[27315]: cluster 1689212876.2298443 mgr.a (mgr.14152) 587 : cluster 0 pgmap v480: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:57.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:56 smithi084 bash[27323]: audit 1689212876.0628657 mon.d (mon.3) 8 : audit 0 from='client.? 172.21.15.137:0/3852177793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:47:57.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:56 smithi084 bash[27323]: cluster 1689212876.2298443 mgr.a (mgr.14152) 587 : cluster 0 pgmap v480: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:56 smithi022 bash[26979]: audit 1689212876.0628657 mon.d (mon.3) 8 : audit 0 from='client.? 172.21.15.137:0/3852177793' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:47:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:56 smithi022 bash[26979]: cluster 1689212876.2298443 mgr.a (mgr.14152) 587 : cluster 0 pgmap v480: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:58.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:47:58 smithi103 bash[27315]: cluster 1689212878.2303798 mgr.a (mgr.14152) 588 : cluster 0 pgmap v481: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:58.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:47:58 smithi084 bash[27323]: cluster 1689212878.2303798 mgr.a (mgr.14152) 588 : cluster 0 pgmap v481: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:58.642 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:47:58 smithi137 bash[27262]: cluster 1689212878.2303798 mgr.a (mgr.14152) 588 : cluster 0 pgmap v481: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:58.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:47:58 smithi022 bash[26979]: cluster 1689212878.2303798 mgr.a (mgr.14152) 588 : cluster 0 pgmap v481: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:58.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:47:58 smithi154 bash[27744]: cluster 1689212878.2303798 mgr.a (mgr.14152) 588 : cluster 0 pgmap v481: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:47:59.800 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:59 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:47:59.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:59 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:47:59.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:47:59 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:01.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:00 smithi154 bash[27744]: cluster 1689212880.2308657 mgr.a (mgr.14152) 589 : cluster 0 pgmap v482: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:01.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:00 smithi137 bash[27262]: cluster 1689212880.2308657 mgr.a (mgr.14152) 589 : cluster 0 pgmap v482: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:01.050 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:00 smithi137 bash[40292]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:01.051 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:00 smithi137 bash[40292]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:01.051 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:00 smithi137 bash[40292]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:01.051 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:00 smithi137 bash[40292]: --> Failed to activate any OSD(s) 2023-07-13T01:48:01.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:00 smithi103 bash[27315]: cluster 1689212880.2308657 mgr.a (mgr.14152) 589 : cluster 0 pgmap v482: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:01.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:00 smithi084 bash[27323]: cluster 1689212880.2308657 mgr.a (mgr.14152) 589 : cluster 0 pgmap v482: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:01.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:00 smithi022 bash[26979]: cluster 1689212880.2308657 mgr.a (mgr.14152) 589 : cluster 0 pgmap v482: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:02.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:02 smithi137 bash[27262]: cluster 1689212882.2313824 mgr.a (mgr.14152) 590 : cluster 0 pgmap v483: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:02.551 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:02 smithi137 bash[40414]: debug 2023-07-13T01:48:02.329+0000 7f483ff42700 1 -- 172.21.15.137:0/1926722450 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558d22b8ad00 con 0x558d22be0800 2023-07-13T01:48:02.551 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:02 smithi137 bash[40414]: debug 2023-07-13T01:48:02.329+0000 7f48490c7640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:02.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:02 smithi103 bash[27315]: cluster 1689212882.2313824 mgr.a (mgr.14152) 590 : cluster 0 pgmap v483: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:02.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:02 smithi084 bash[27323]: cluster 1689212882.2313824 mgr.a (mgr.14152) 590 : cluster 0 pgmap v483: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:02.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:02 smithi022 bash[26979]: cluster 1689212882.2313824 mgr.a (mgr.14152) 590 : cluster 0 pgmap v483: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:02.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:02 smithi154 bash[27744]: cluster 1689212882.2313824 mgr.a (mgr.14152) 590 : cluster 0 pgmap v483: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:03.550 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:03 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:04.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:04 smithi137 bash[27262]: cluster 1689212884.231866 mgr.a (mgr.14152) 591 : cluster 0 pgmap v484: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:04.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:04 smithi103 bash[27315]: cluster 1689212884.231866 mgr.a (mgr.14152) 591 : cluster 0 pgmap v484: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:04.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:04 smithi084 bash[27323]: cluster 1689212884.231866 mgr.a (mgr.14152) 591 : cluster 0 pgmap v484: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:04.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:04 smithi022 bash[26979]: cluster 1689212884.231866 mgr.a (mgr.14152) 591 : cluster 0 pgmap v484: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:04.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:04 smithi154 bash[27744]: cluster 1689212884.231866 mgr.a (mgr.14152) 591 : cluster 0 pgmap v484: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:05.914 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:05 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:48:06.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:06 smithi103 bash[27315]: cluster 1689212886.2323537 mgr.a (mgr.14152) 592 : cluster 0 pgmap v485: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:06.626 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:06 smithi137 bash[27262]: cluster 1689212886.2323537 mgr.a (mgr.14152) 592 : cluster 0 pgmap v485: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:06.627 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:06 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:48:06.627 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:06 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:06.627 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:06 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:06.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:06 smithi084 bash[27323]: cluster 1689212886.2323537 mgr.a (mgr.14152) 592 : cluster 0 pgmap v485: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:06.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:06 smithi022 bash[26979]: cluster 1689212886.2323537 mgr.a (mgr.14152) 592 : cluster 0 pgmap v485: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:06.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:06 smithi154 bash[27744]: cluster 1689212886.2323537 mgr.a (mgr.14152) 592 : cluster 0 pgmap v485: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:08.565 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:08 smithi137 bash[27262]: cluster 1689212888.2328298 mgr.a (mgr.14152) 593 : cluster 0 pgmap v486: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:08.565 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:08 smithi137 bash[40775]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:08.565 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:08 smithi137 bash[40775]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:08.565 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:08 smithi137 bash[40775]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:08.566 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:08 smithi137 bash[40775]: --> Failed to activate any OSD(s) 2023-07-13T01:48:08.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:08 smithi103 bash[27315]: cluster 1689212888.2328298 mgr.a (mgr.14152) 593 : cluster 0 pgmap v486: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:08.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:08 smithi084 bash[27323]: cluster 1689212888.2328298 mgr.a (mgr.14152) 593 : cluster 0 pgmap v486: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:08.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:08 smithi022 bash[26979]: cluster 1689212888.2328298 mgr.a (mgr.14152) 593 : cluster 0 pgmap v486: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:08.752 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:08 smithi154 bash[27744]: cluster 1689212888.2328298 mgr.a (mgr.14152) 593 : cluster 0 pgmap v486: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:11.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:10 smithi154 bash[27744]: audit 1689212889.7953765 mon.a (mon.0) 857 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-13T01:48:11.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:10 smithi154 bash[27744]: audit 1689212889.7968688 mon.a (mon.0) 858 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:11.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:10 smithi154 bash[27744]: cephadm 1689212889.7981758 mgr.a (mgr.14152) 594 : cephadm 1 Deploying daemon osd.11 on smithi137 2023-07-13T01:48:11.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:10 smithi154 bash[27744]: cluster 1689212890.233284 mgr.a (mgr.14152) 595 : cluster 0 pgmap v487: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:11.039 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:10 smithi137 bash[27262]: audit 1689212889.7953765 mon.a (mon.0) 857 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-13T01:48:11.039 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:10 smithi137 bash[27262]: audit 1689212889.7968688 mon.a (mon.0) 858 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:11.039 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:10 smithi137 bash[27262]: cephadm 1689212889.7981758 mgr.a (mgr.14152) 594 : cephadm 1 Deploying daemon osd.11 on smithi137 2023-07-13T01:48:11.040 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:10 smithi137 bash[27262]: cluster 1689212890.233284 mgr.a (mgr.14152) 595 : cluster 0 pgmap v487: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:11.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:10 smithi103 bash[27315]: audit 1689212889.7953765 mon.a (mon.0) 857 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-13T01:48:11.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:10 smithi103 bash[27315]: audit 1689212889.7968688 mon.a (mon.0) 858 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:11.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:10 smithi103 bash[27315]: cephadm 1689212889.7981758 mgr.a (mgr.14152) 594 : cephadm 1 Deploying daemon osd.11 on smithi137 2023-07-13T01:48:11.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:10 smithi103 bash[27315]: cluster 1689212890.233284 mgr.a (mgr.14152) 595 : cluster 0 pgmap v487: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:11.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:10 smithi084 bash[27323]: audit 1689212889.7953765 mon.a (mon.0) 857 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-13T01:48:11.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:10 smithi084 bash[27323]: audit 1689212889.7968688 mon.a (mon.0) 858 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:11.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:10 smithi084 bash[27323]: cephadm 1689212889.7981758 mgr.a (mgr.14152) 594 : cephadm 1 Deploying daemon osd.11 on smithi137 2023-07-13T01:48:11.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:10 smithi084 bash[27323]: cluster 1689212890.233284 mgr.a (mgr.14152) 595 : cluster 0 pgmap v487: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:11.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:10 smithi022 bash[26979]: audit 1689212889.7953765 mon.a (mon.0) 857 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-13T01:48:11.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:10 smithi022 bash[26979]: audit 1689212889.7968688 mon.a (mon.0) 858 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:11.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:10 smithi022 bash[26979]: cephadm 1689212889.7981758 mgr.a (mgr.14152) 594 : cephadm 1 Deploying daemon osd.11 on smithi137 2023-07-13T01:48:11.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:10 smithi022 bash[26979]: cluster 1689212890.233284 mgr.a (mgr.14152) 595 : cluster 0 pgmap v487: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:11.334 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:11 smithi137 bash[40963]: debug 2023-07-13T01:48:11.085+0000 7f92d446c700 1 -- 172.21.15.137:0/213434350 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d8d6b92d00 con 0x55d8d6be8800 2023-07-13T01:48:11.334 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:11 smithi137 bash[40963]: debug 2023-07-13T01:48:11.089+0000 7f92dd5f1640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:12.050 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:11 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:12.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:12 smithi103 bash[27315]: cluster 1689212892.2337866 mgr.a (mgr.14152) 596 : cluster 0 pgmap v488: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:12.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:12 smithi084 bash[27323]: cluster 1689212892.2337866 mgr.a (mgr.14152) 596 : cluster 0 pgmap v488: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:12.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:12 smithi022 bash[26979]: cluster 1689212892.2337866 mgr.a (mgr.14152) 596 : cluster 0 pgmap v488: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:12.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:12 smithi154 bash[27744]: cluster 1689212892.2337866 mgr.a (mgr.14152) 596 : cluster 0 pgmap v488: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:12.775 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:12 smithi137 bash[27262]: cluster 1689212892.2337866 mgr.a (mgr.14152) 596 : cluster 0 pgmap v488: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:14.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:14 smithi103 bash[27315]: cluster 1689212894.2342763 mgr.a (mgr.14152) 597 : cluster 0 pgmap v489: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:14.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:14 smithi084 bash[27323]: cluster 1689212894.2342763 mgr.a (mgr.14152) 597 : cluster 0 pgmap v489: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:14.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:14 smithi022 bash[26979]: cluster 1689212894.2342763 mgr.a (mgr.14152) 597 : cluster 0 pgmap v489: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:14.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:14 smithi154 bash[27744]: cluster 1689212894.2342763 mgr.a (mgr.14152) 597 : cluster 0 pgmap v489: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:14.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:14 smithi137 bash[27262]: cluster 1689212894.2342763 mgr.a (mgr.14152) 597 : cluster 0 pgmap v489: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:15.549 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:15 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:48:16.001 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:15 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:48:16.001 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:15 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:16.001 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:15 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:17.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[27262]: audit 1689212896.0470707 mon.a (mon.0) 859 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[27262]: audit 1689212896.0550911 mon.a (mon.0) 860 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[27262]: audit 1689212896.0740342 mon.a (mon.0) 861 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:17.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[27262]: cluster 1689212896.2347844 mgr.a (mgr.14152) 598 : cluster 0 pgmap v490: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:17.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:17 smithi103 bash[27315]: audit 1689212896.0470707 mon.a (mon.0) 859 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:17 smithi103 bash[27315]: audit 1689212896.0550911 mon.a (mon.0) 860 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:17 smithi103 bash[27315]: audit 1689212896.0740342 mon.a (mon.0) 861 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:17.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:17 smithi103 bash[27315]: cluster 1689212896.2347844 mgr.a (mgr.14152) 598 : cluster 0 pgmap v490: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:17.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:17 smithi084 bash[27323]: audit 1689212896.0470707 mon.a (mon.0) 859 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:17 smithi084 bash[27323]: audit 1689212896.0550911 mon.a (mon.0) 860 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:17 smithi084 bash[27323]: audit 1689212896.0740342 mon.a (mon.0) 861 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:17.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:17 smithi084 bash[27323]: cluster 1689212896.2347844 mgr.a (mgr.14152) 598 : cluster 0 pgmap v490: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:17.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:17 smithi022 bash[26979]: audit 1689212896.0470707 mon.a (mon.0) 859 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:17 smithi022 bash[26979]: audit 1689212896.0550911 mon.a (mon.0) 860 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:17 smithi022 bash[26979]: audit 1689212896.0740342 mon.a (mon.0) 861 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:17.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:17 smithi022 bash[26979]: cluster 1689212896.2347844 mgr.a (mgr.14152) 598 : cluster 0 pgmap v490: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:17.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:17 smithi154 bash[27744]: audit 1689212896.0470707 mon.a (mon.0) 859 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:17 smithi154 bash[27744]: audit 1689212896.0550911 mon.a (mon.0) 860 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:17.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:17 smithi154 bash[27744]: audit 1689212896.0740342 mon.a (mon.0) 861 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:17.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:17 smithi154 bash[27744]: cluster 1689212896.2347844 mgr.a (mgr.14152) 598 : cluster 0 pgmap v490: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:18.050 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[41457]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:18.051 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[41457]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:18.051 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[41457]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:18.051 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:17 smithi137 bash[41457]: --> Failed to activate any OSD(s) 2023-07-13T01:48:18.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:18 smithi137 bash[27262]: cluster 1689212898.2352417 mgr.a (mgr.14152) 599 : cluster 0 pgmap v491: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:18.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:18 smithi103 bash[27315]: cluster 1689212898.2352417 mgr.a (mgr.14152) 599 : cluster 0 pgmap v491: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:18.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:18 smithi084 bash[27323]: cluster 1689212898.2352417 mgr.a (mgr.14152) 599 : cluster 0 pgmap v491: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:18.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:18 smithi022 bash[26979]: cluster 1689212898.2352417 mgr.a (mgr.14152) 599 : cluster 0 pgmap v491: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:18.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:18 smithi154 bash[27744]: cluster 1689212898.2352417 mgr.a (mgr.14152) 599 : cluster 0 pgmap v491: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:20.531 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:20 smithi137 bash[41750]: debug 2023-07-13T01:48:20.421+0000 7ff015df4700 1 -- 172.21.15.137:0/2080027845 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cef792ed00 con 0x55cef7985000 2023-07-13T01:48:20.531 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:20 smithi137 bash[41750]: debug 2023-07-13T01:48:20.425+0000 7ff01ef79640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:20.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:20 smithi137 bash[27262]: cluster 1689212900.2357283 mgr.a (mgr.14152) 600 : cluster 0 pgmap v492: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:21.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:20 smithi154 bash[27744]: cluster 1689212900.2357283 mgr.a (mgr.14152) 600 : cluster 0 pgmap v492: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:21.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:20 smithi103 bash[27315]: cluster 1689212900.2357283 mgr.a (mgr.14152) 600 : cluster 0 pgmap v492: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:21.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:20 smithi084 bash[27323]: cluster 1689212900.2357283 mgr.a (mgr.14152) 600 : cluster 0 pgmap v492: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:21.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:20 smithi022 bash[26979]: cluster 1689212900.2357283 mgr.a (mgr.14152) 600 : cluster 0 pgmap v492: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:22.049 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:21 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:22.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:22 smithi137 bash[27262]: cluster 1689212902.2362256 mgr.a (mgr.14152) 601 : cluster 0 pgmap v493: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:22.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:22 smithi103 bash[27315]: cluster 1689212902.2362256 mgr.a (mgr.14152) 601 : cluster 0 pgmap v493: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:22.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:22 smithi084 bash[27323]: cluster 1689212902.2362256 mgr.a (mgr.14152) 601 : cluster 0 pgmap v493: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:22.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:22 smithi022 bash[26979]: cluster 1689212902.2362256 mgr.a (mgr.14152) 601 : cluster 0 pgmap v493: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:22.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:22 smithi154 bash[27744]: cluster 1689212902.2362256 mgr.a (mgr.14152) 601 : cluster 0 pgmap v493: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:23.792 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: audit 1689212902.7367482 mon.a (mon.0) 862 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:23.792 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: audit 1689212902.744598 mon.a (mon.0) 863 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:23.793 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: audit 1689212903.2167993 mon.a (mon.0) 864 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:23.793 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: audit 1689212903.2185395 mon.a (mon.0) 865 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:23.793 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: cluster 1689212903.221697 mgr.a (mgr.14152) 602 : cluster 0 pgmap v494: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:23.793 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: cluster 1689212903.2220144 mgr.a (mgr.14152) 603 : cluster 0 pgmap v495: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:23.793 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:23 smithi137 bash[27262]: audit 1689212903.229939 mon.a (mon.0) 866 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: audit 1689212902.7367482 mon.a (mon.0) 862 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: audit 1689212902.744598 mon.a (mon.0) 863 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: audit 1689212903.2167993 mon.a (mon.0) 864 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:24.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: audit 1689212903.2185395 mon.a (mon.0) 865 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:24.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: cluster 1689212903.221697 mgr.a (mgr.14152) 602 : cluster 0 pgmap v494: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: cluster 1689212903.2220144 mgr.a (mgr.14152) 603 : cluster 0 pgmap v495: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:23 smithi154 bash[27744]: audit 1689212903.229939 mon.a (mon.0) 866 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: audit 1689212902.7367482 mon.a (mon.0) 862 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: audit 1689212902.744598 mon.a (mon.0) 863 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: audit 1689212903.2167993 mon.a (mon.0) 864 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:24.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: audit 1689212903.2185395 mon.a (mon.0) 865 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:24.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: cluster 1689212903.221697 mgr.a (mgr.14152) 602 : cluster 0 pgmap v494: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: cluster 1689212903.2220144 mgr.a (mgr.14152) 603 : cluster 0 pgmap v495: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:23 smithi103 bash[27315]: audit 1689212903.229939 mon.a (mon.0) 866 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: audit 1689212902.7367482 mon.a (mon.0) 862 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: audit 1689212902.744598 mon.a (mon.0) 863 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: audit 1689212903.2167993 mon.a (mon.0) 864 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:24.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: audit 1689212903.2185395 mon.a (mon.0) 865 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:24.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: cluster 1689212903.221697 mgr.a (mgr.14152) 602 : cluster 0 pgmap v494: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: cluster 1689212903.2220144 mgr.a (mgr.14152) 603 : cluster 0 pgmap v495: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:23 smithi084 bash[27323]: audit 1689212903.229939 mon.a (mon.0) 866 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: audit 1689212902.7367482 mon.a (mon.0) 862 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: audit 1689212902.744598 mon.a (mon.0) 863 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:24.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: audit 1689212903.2167993 mon.a (mon.0) 864 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:24.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: audit 1689212903.2185395 mon.a (mon.0) 865 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:24.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: cluster 1689212903.221697 mgr.a (mgr.14152) 602 : cluster 0 pgmap v494: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: cluster 1689212903.2220144 mgr.a (mgr.14152) 603 : cluster 0 pgmap v495: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:24.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:23 smithi022 bash[26979]: audit 1689212903.229939 mon.a (mon.0) 866 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:25.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:24 smithi154 bash[27744]: cluster 1689212903.741149 mon.a (mon.0) 867 : cluster 3 Health check update: 11 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:48:25.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:24 smithi137 bash[27262]: cluster 1689212903.741149 mon.a (mon.0) 867 : cluster 3 Health check update: 11 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:48:25.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:24 smithi103 bash[27315]: cluster 1689212903.741149 mon.a (mon.0) 867 : cluster 3 Health check update: 11 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:48:25.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:24 smithi084 bash[27323]: cluster 1689212903.741149 mon.a (mon.0) 867 : cluster 3 Health check update: 11 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:48:25.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:24 smithi022 bash[26979]: cluster 1689212903.741149 mon.a (mon.0) 867 : cluster 3 Health check update: 11 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:48:25.375 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:25 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:48:25.375 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:25 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:25.375 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:25 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:26.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:25 smithi154 bash[27744]: cluster 1689212905.2225053 mgr.a (mgr.14152) 604 : cluster 0 pgmap v496: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:26.015 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:25 smithi137 bash[27262]: cluster 1689212905.2225053 mgr.a (mgr.14152) 604 : cluster 0 pgmap v496: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:26.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:25 smithi103 bash[27315]: cluster 1689212905.2225053 mgr.a (mgr.14152) 604 : cluster 0 pgmap v496: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:26.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:25 smithi084 bash[27323]: cluster 1689212905.2225053 mgr.a (mgr.14152) 604 : cluster 0 pgmap v496: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:26.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:25 smithi022 bash[26979]: cluster 1689212905.2225053 mgr.a (mgr.14152) 604 : cluster 0 pgmap v496: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:26.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:26 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:48:27.580 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:27 smithi137 bash[27262]: cluster 1689212907.2230127 mgr.a (mgr.14152) 605 : cluster 0 pgmap v497: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:27.580 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:27 smithi137 bash[42593]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:27.580 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:27 smithi137 bash[42593]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:27.581 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:27 smithi137 bash[42593]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:27.581 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:27 smithi137 bash[42593]: --> Failed to activate any OSD(s) 2023-07-13T01:48:27.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:27 smithi103 bash[27315]: cluster 1689212907.2230127 mgr.a (mgr.14152) 605 : cluster 0 pgmap v497: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:27.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:27 smithi084 bash[27323]: cluster 1689212907.2230127 mgr.a (mgr.14152) 605 : cluster 0 pgmap v497: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:27.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:27 smithi022 bash[26979]: cluster 1689212907.2230127 mgr.a (mgr.14152) 605 : cluster 0 pgmap v497: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:27.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:27 smithi154 bash[27744]: cluster 1689212907.2230127 mgr.a (mgr.14152) 605 : cluster 0 pgmap v497: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:28.766 INFO:teuthology.orchestra.run.smithi137.stdout:Created osd(s) 11 on host 'smithi137' 2023-07-13T01:48:29.913 DEBUG:teuthology.orchestra.run.smithi137:osd.11> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service 2023-07-13T01:48:29.916 INFO:tasks.cephadm:Deploying osd.12 on smithi154 with /dev/vg_nvme/lv_4... 2023-07-13T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-13T01:48:30.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:29 smithi154 bash[27744]: audit 1689212908.720598 mon.a (mon.0) 868 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:29 smithi154 bash[27744]: audit 1689212908.7285526 mon.a (mon.0) 869 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:29 smithi154 bash[27744]: audit 1689212908.7289839 mon.a (mon.0) 870 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:30.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:29 smithi154 bash[27744]: cluster 1689212909.223494 mgr.a (mgr.14152) 606 : cluster 0 pgmap v498: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:30.007 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:29 smithi137 bash[27262]: audit 1689212908.720598 mon.a (mon.0) 868 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.007 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:29 smithi137 bash[27262]: audit 1689212908.7285526 mon.a (mon.0) 869 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.008 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:29 smithi137 bash[27262]: audit 1689212908.7289839 mon.a (mon.0) 870 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:30.008 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:29 smithi137 bash[27262]: cluster 1689212909.223494 mgr.a (mgr.14152) 606 : cluster 0 pgmap v498: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:30.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:29 smithi103 bash[27315]: audit 1689212908.720598 mon.a (mon.0) 868 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:29 smithi103 bash[27315]: audit 1689212908.7285526 mon.a (mon.0) 869 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:29 smithi103 bash[27315]: audit 1689212908.7289839 mon.a (mon.0) 870 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:30.101 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:29 smithi103 bash[27315]: cluster 1689212909.223494 mgr.a (mgr.14152) 606 : cluster 0 pgmap v498: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:30.137 INFO:journalctl@ceph.osd.11.smithi137.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:48:30.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:29 smithi084 bash[27323]: audit 1689212908.720598 mon.a (mon.0) 868 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:29 smithi084 bash[27323]: audit 1689212908.7285526 mon.a (mon.0) 869 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:29 smithi084 bash[27323]: audit 1689212908.7289839 mon.a (mon.0) 870 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:30.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:29 smithi084 bash[27323]: cluster 1689212909.223494 mgr.a (mgr.14152) 606 : cluster 0 pgmap v498: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:30.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:29 smithi022 bash[26979]: audit 1689212908.720598 mon.a (mon.0) 868 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:29 smithi022 bash[26979]: audit 1689212908.7285526 mon.a (mon.0) 869 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:30.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:29 smithi022 bash[26979]: audit 1689212908.7289839 mon.a (mon.0) 870 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:48:30.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:29 smithi022 bash[26979]: cluster 1689212909.223494 mgr.a (mgr.14152) 606 : cluster 0 pgmap v498: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:30.313 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:30 smithi137 bash[42800]: debug 2023-07-13T01:48:30.061+0000 7fb529cec700 1 -- 172.21.15.137:0/1379608934 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c04784d00 con 0x556c047db000 2023-07-13T01:48:30.313 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:30 smithi137 bash[42800]: debug 2023-07-13T01:48:30.061+0000 7fb532e71640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:31.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:30 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:31.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:31 smithi103 bash[27315]: cluster 1689212911.2240183 mgr.a (mgr.14152) 607 : cluster 0 pgmap v499: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:31.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:31 smithi084 bash[27323]: cluster 1689212911.2240183 mgr.a (mgr.14152) 607 : cluster 0 pgmap v499: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:31.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:31 smithi022 bash[26979]: cluster 1689212911.2240183 mgr.a (mgr.14152) 607 : cluster 0 pgmap v499: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:31.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:31 smithi154 bash[27744]: cluster 1689212911.2240183 mgr.a (mgr.14152) 607 : cluster 0 pgmap v499: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:31.799 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:31 smithi137 bash[27262]: cluster 1689212911.2240183 mgr.a (mgr.14152) 607 : cluster 0 pgmap v499: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:33.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:33 smithi103 bash[27315]: cluster 1689212913.2245238 mgr.a (mgr.14152) 608 : cluster 0 pgmap v500: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:33.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:33 smithi084 bash[27323]: cluster 1689212913.2245238 mgr.a (mgr.14152) 608 : cluster 0 pgmap v500: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:33.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:33 smithi022 bash[26979]: cluster 1689212913.2245238 mgr.a (mgr.14152) 608 : cluster 0 pgmap v500: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:33.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:33 smithi154 bash[27744]: cluster 1689212913.2245238 mgr.a (mgr.14152) 608 : cluster 0 pgmap v500: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:33.799 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:33 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:48:33.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:33 smithi137 bash[27262]: cluster 1689212913.2245238 mgr.a (mgr.14152) 608 : cluster 0 pgmap v500: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:34.603 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:48:35.964 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:35 smithi154 bash[27744]: cluster 1689212915.2250156 mgr.a (mgr.14152) 609 : cluster 0 pgmap v501: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:36.038 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:35 smithi137 bash[27262]: cluster 1689212915.2250156 mgr.a (mgr.14152) 609 : cluster 0 pgmap v501: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:36.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:35 smithi103 bash[27315]: cluster 1689212915.2250156 mgr.a (mgr.14152) 609 : cluster 0 pgmap v501: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:36.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:35 smithi084 bash[27323]: cluster 1689212915.2250156 mgr.a (mgr.14152) 609 : cluster 0 pgmap v501: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:36.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:35 smithi022 bash[26979]: cluster 1689212915.2250156 mgr.a (mgr.14152) 609 : cluster 0 pgmap v501: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:36.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:36 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:48:36.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:36 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:36.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:36 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:36.380 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:36 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:48:36.381 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:36 smithi137 systemd[1]: Stopped Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:36.381 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:36 smithi137 systemd[1]: Started Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:37.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:37 smithi103 bash[27315]: cluster 1689212917.225511 mgr.a (mgr.14152) 610 : cluster 0 pgmap v502: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:37.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:37 smithi084 bash[27323]: cluster 1689212917.225511 mgr.a (mgr.14152) 610 : cluster 0 pgmap v502: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:37.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:37 smithi022 bash[26979]: cluster 1689212917.225511 mgr.a (mgr.14152) 610 : cluster 0 pgmap v502: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:37.751 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:37 smithi154 bash[27744]: cluster 1689212917.225511 mgr.a (mgr.14152) 610 : cluster 0 pgmap v502: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:37.799 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:37 smithi137 bash[27262]: cluster 1689212917.225511 mgr.a (mgr.14152) 610 : cluster 0 pgmap v502: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:37.989 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-13T01:48:37.989 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-13T01:48:37.989 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2023-07-13T01:48:37.990 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2023-07-13T01:48:37.990 INFO:teuthology.orchestra.run.smithi154.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154934 s, 677 MB/s 2023-07-13T01:48:37.990 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 2023-07-13T01:48:37.990 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2023-07-13T01:48:38.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2023-07-13T01:48:38.854 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43918]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:38.854 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43918]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:38.854 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43918]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:38.854 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43918]: --> Failed to activate any OSD(s) 2023-07-13T01:48:38.855 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43277]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:38.855 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43277]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:38.855 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43277]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:38.855 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[43277]: --> Failed to activate any OSD(s) 2023-07-13T01:48:39.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: cephadm 1689212917.874716 mgr.a (mgr.14152) 611 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:48:39.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.8840888 mon.a (mon.0) 871 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.8915925 mon.a (mon.0) 872 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.892997 mon.a (mon.0) 873 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.8942416 mon.a (mon.0) 874 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.895402 mon.a (mon.0) 875 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.002 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: cephadm 1689212917.8965356 mgr.a (mgr.14152) 612 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:48:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.9031708 mon.a (mon.0) 876 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.9048889 mon.a (mon.0) 877 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.9062176 mon.a (mon.0) 878 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: cluster 1689212917.909144 mgr.a (mgr.14152) 613 : cluster 0 pgmap v503: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: cluster 1689212917.9093592 mgr.a (mgr.14152) 614 : cluster 0 pgmap v504: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.003 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:38 smithi154 bash[27744]: audit 1689212917.915871 mon.a (mon.0) 879 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: cephadm 1689212917.874716 mgr.a (mgr.14152) 611 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:48:39.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.8840888 mon.a (mon.0) 871 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.8915925 mon.a (mon.0) 872 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.892997 mon.a (mon.0) 873 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.8942416 mon.a (mon.0) 874 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.895402 mon.a (mon.0) 875 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: cephadm 1689212917.8965356 mgr.a (mgr.14152) 612 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.9031708 mon.a (mon.0) 876 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.9048889 mon.a (mon.0) 877 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:39.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.9062176 mon.a (mon.0) 878 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:39.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: cluster 1689212917.909144 mgr.a (mgr.14152) 613 : cluster 0 pgmap v503: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: cluster 1689212917.9093592 mgr.a (mgr.14152) 614 : cluster 0 pgmap v504: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:38 smithi084 bash[27323]: audit 1689212917.915871 mon.a (mon.0) 879 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: cephadm 1689212917.874716 mgr.a (mgr.14152) 611 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:48:39.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.8840888 mon.a (mon.0) 871 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.8915925 mon.a (mon.0) 872 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.892997 mon.a (mon.0) 873 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.8942416 mon.a (mon.0) 874 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.895402 mon.a (mon.0) 875 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: cephadm 1689212917.8965356 mgr.a (mgr.14152) 612 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:48:39.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.9031708 mon.a (mon.0) 876 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.9048889 mon.a (mon.0) 877 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:39.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.9062176 mon.a (mon.0) 878 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:39.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: cluster 1689212917.909144 mgr.a (mgr.14152) 613 : cluster 0 pgmap v503: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: cluster 1689212917.9093592 mgr.a (mgr.14152) 614 : cluster 0 pgmap v504: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:38 smithi022 bash[26979]: audit 1689212917.915871 mon.a (mon.0) 879 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: cephadm 1689212917.874716 mgr.a (mgr.14152) 611 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:48:39.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.8840888 mon.a (mon.0) 871 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.8915925 mon.a (mon.0) 872 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.892997 mon.a (mon.0) 873 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.8942416 mon.a (mon.0) 874 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.895402 mon.a (mon.0) 875 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: cephadm 1689212917.8965356 mgr.a (mgr.14152) 612 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:48:39.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.9031708 mon.a (mon.0) 876 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.9048889 mon.a (mon.0) 877 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:39.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.9062176 mon.a (mon.0) 878 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:39.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: cluster 1689212917.909144 mgr.a (mgr.14152) 613 : cluster 0 pgmap v503: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: cluster 1689212917.9093592 mgr.a (mgr.14152) 614 : cluster 0 pgmap v504: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:38 smithi137 bash[27262]: audit 1689212917.915871 mon.a (mon.0) 879 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: cephadm 1689212917.874716 mgr.a (mgr.14152) 611 : cephadm 1 Detected new or changed devices on smithi137 2023-07-13T01:48:39.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.8840888 mon.a (mon.0) 871 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.8915925 mon.a (mon.0) 872 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.892997 mon.a (mon.0) 873 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.8942416 mon.a (mon.0) 874 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.895402 mon.a (mon.0) 875 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:48:39.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: cephadm 1689212917.8965356 mgr.a (mgr.14152) 612 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:48:39.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.9031708 mon.a (mon.0) 876 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:39.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.9048889 mon.a (mon.0) 877 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:39.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.9062176 mon.a (mon.0) 878 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:48:39.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: cluster 1689212917.909144 mgr.a (mgr.14152) 613 : cluster 0 pgmap v503: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: cluster 1689212917.9093592 mgr.a (mgr.14152) 614 : cluster 0 pgmap v504: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:39.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:38 smithi103 bash[27315]: audit 1689212917.915871 mon.a (mon.0) 879 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:48:41.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:40 smithi154 bash[27744]: cluster 1689212919.9098408 mgr.a (mgr.14152) 615 : cluster 0 pgmap v505: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:41.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:40 smithi137 bash[27262]: cluster 1689212919.9098408 mgr.a (mgr.14152) 615 : cluster 0 pgmap v505: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:41.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:40 smithi103 bash[27315]: cluster 1689212919.9098408 mgr.a (mgr.14152) 615 : cluster 0 pgmap v505: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:41.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:40 smithi084 bash[27323]: cluster 1689212919.9098408 mgr.a (mgr.14152) 615 : cluster 0 pgmap v505: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:41.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:40 smithi022 bash[26979]: cluster 1689212919.9098408 mgr.a (mgr.14152) 615 : cluster 0 pgmap v505: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:41.309 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:41 smithi137 bash[44114]: debug 2023-07-13T01:48:41.177+0000 7f3082693700 1 -- 172.21.15.137:0/876582627 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5571d5cf6d00 con 0x5571d5d4d000 2023-07-13T01:48:41.309 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:41 smithi137 bash[44114]: debug 2023-07-13T01:48:41.177+0000 7f308b818640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:41.310 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:41 smithi137 bash[44137]: debug 2023-07-13T01:48:41.197+0000 7f146524e700 1 -- 172.21.15.137:0/16397927 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e3f6d36d00 con 0x55e3f6d8c800 2023-07-13T01:48:41.310 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:41 smithi137 bash[44137]: debug 2023-07-13T01:48:41.197+0000 7f146e3d3640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:42.549 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:42 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:42.550 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:42 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:43.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:42 smithi154 bash[27744]: cluster 1689212921.910367 mgr.a (mgr.14152) 616 : cluster 0 pgmap v506: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:43.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:42 smithi137 bash[27262]: cluster 1689212921.910367 mgr.a (mgr.14152) 616 : cluster 0 pgmap v506: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:43.333 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:48:43.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:42 smithi103 bash[27315]: cluster 1689212921.910367 mgr.a (mgr.14152) 616 : cluster 0 pgmap v506: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:43.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:42 smithi084 bash[27323]: cluster 1689212921.910367 mgr.a (mgr.14152) 616 : cluster 0 pgmap v506: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:42 smithi022 bash[26979]: cluster 1689212921.910367 mgr.a (mgr.14152) 616 : cluster 0 pgmap v506: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:43.866 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:43 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:48:43.866 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:43 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:43.866 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:43 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:45.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:44 smithi137 bash[27262]: cluster 1689212923.9109323 mgr.a (mgr.14152) 617 : cluster 0 pgmap v507: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:45.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:44 smithi154 bash[27744]: cluster 1689212923.9109323 mgr.a (mgr.14152) 617 : cluster 0 pgmap v507: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:45.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:44 smithi103 bash[27315]: cluster 1689212923.9109323 mgr.a (mgr.14152) 617 : cluster 0 pgmap v507: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:45.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:44 smithi084 bash[27323]: cluster 1689212923.9109323 mgr.a (mgr.14152) 617 : cluster 0 pgmap v507: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:45.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:44 smithi022 bash[26979]: cluster 1689212923.9109323 mgr.a (mgr.14152) 617 : cluster 0 pgmap v507: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:46.176 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:45 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:48:46.177 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:45 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Failed with result 'exit-code'. 2023-07-13T01:48:46.549 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[44464]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:46.550 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[44464]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:46.550 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[44464]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:46.550 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[44464]: --> Failed to activate any OSD(s) 2023-07-13T01:48:47.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:46 smithi154 bash[27744]: cluster 1689212925.9114711 mgr.a (mgr.14152) 618 : cluster 0 pgmap v508: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:47.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:46 smithi154 bash[27744]: audit 1689212926.475575 mon.a (mon.0) 880 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:48:47.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:46 smithi154 bash[27744]: audit 1689212926.4815211 mon.a (mon.0) 881 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:48:47.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:46 smithi154 bash[27744]: audit 1689212926.4835157 mon.a (mon.0) 882 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:47.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[27262]: cluster 1689212925.9114711 mgr.a (mgr.14152) 618 : cluster 0 pgmap v508: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:47.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[27262]: audit 1689212926.475575 mon.a (mon.0) 880 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:48:47.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[27262]: audit 1689212926.4815211 mon.a (mon.0) 881 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:48:47.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:46 smithi137 bash[27262]: audit 1689212926.4835157 mon.a (mon.0) 882 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:47.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:46 smithi103 bash[27315]: cluster 1689212925.9114711 mgr.a (mgr.14152) 618 : cluster 0 pgmap v508: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:47.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:46 smithi103 bash[27315]: audit 1689212926.475575 mon.a (mon.0) 880 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:48:47.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:46 smithi103 bash[27315]: audit 1689212926.4815211 mon.a (mon.0) 881 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:48:47.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:46 smithi103 bash[27315]: audit 1689212926.4835157 mon.a (mon.0) 882 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:47.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:46 smithi084 bash[27323]: cluster 1689212925.9114711 mgr.a (mgr.14152) 618 : cluster 0 pgmap v508: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:47.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:46 smithi084 bash[27323]: audit 1689212926.475575 mon.a (mon.0) 880 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:48:47.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:46 smithi084 bash[27323]: audit 1689212926.4815211 mon.a (mon.0) 881 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:48:47.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:46 smithi084 bash[27323]: audit 1689212926.4835157 mon.a (mon.0) 882 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:47.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:46 smithi022 bash[26979]: cluster 1689212925.9114711 mgr.a (mgr.14152) 618 : cluster 0 pgmap v508: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:47.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:46 smithi022 bash[26979]: audit 1689212926.475575 mon.a (mon.0) 880 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:48:47.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:46 smithi022 bash[26979]: audit 1689212926.4815211 mon.a (mon.0) 881 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:48:47.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:46 smithi022 bash[26979]: audit 1689212926.4835157 mon.a (mon.0) 882 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:48:48.159 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:47 smithi137 bash[44718]: debug 2023-07-13T01:48:47.985+0000 7fce244e3640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:48:48.160 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:47 smithi137 bash[27262]: audit 1689212926.468197 mgr.a (mgr.14152) 619 : audit 0 from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:48:48.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:47 smithi154 bash[27744]: audit 1689212926.468197 mgr.a (mgr.14152) 619 : audit 0 from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:48:48.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:47 smithi103 bash[27315]: audit 1689212926.468197 mgr.a (mgr.14152) 619 : audit 0 from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:48:48.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:47 smithi084 bash[27323]: audit 1689212926.468197 mgr.a (mgr.14152) 619 : audit 0 from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:48:48.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:47 smithi022 bash[26979]: audit 1689212926.468197 mgr.a (mgr.14152) 619 : audit 0 from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:48:48.976 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:48 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:48:49.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:48 smithi154 bash[27744]: cluster 1689212927.9119852 mgr.a (mgr.14152) 620 : cluster 0 pgmap v509: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:49.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:48 smithi137 bash[27262]: cluster 1689212927.9119852 mgr.a (mgr.14152) 620 : cluster 0 pgmap v509: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:49.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:48 smithi103 bash[27315]: cluster 1689212927.9119852 mgr.a (mgr.14152) 620 : cluster 0 pgmap v509: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:49.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:48 smithi084 bash[27323]: cluster 1689212927.9119852 mgr.a (mgr.14152) 620 : cluster 0 pgmap v509: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:49.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:48 smithi022 bash[26979]: cluster 1689212927.9119852 mgr.a (mgr.14152) 620 : cluster 0 pgmap v509: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:50.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: cluster 1689212929.729657 mon.a (mon.0) 883 : cluster 1 Marking osd.2 out (has been down for 600 seconds) 2023-07-13T01:48:50.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: cluster 1689212929.739733 mon.a (mon.0) 884 : cluster 0 osdmap e19: 12 total, 0 up, 9 in 2023-07-13T01:48:50.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7402794 mon.a (mon.0) 885 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:50.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.741395 mon.a (mon.0) 886 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:50.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7452164 mon.a (mon.0) 887 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:50.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7459342 mon.a (mon.0) 888 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:50.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7464514 mon.a (mon.0) 889 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7469716 mon.a (mon.0) 890 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7473588 mon.a (mon.0) 891 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.747731 mon.a (mon.0) 892 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7481008 mon.a (mon.0) 893 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7484837 mon.a (mon.0) 894 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.7487977 mon.a (mon.0) 895 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:50.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:49 smithi137 bash[27262]: audit 1689212929.749052 mon.a (mon.0) 896 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: cluster 1689212929.729657 mon.a (mon.0) 883 : cluster 1 Marking osd.2 out (has been down for 600 seconds) 2023-07-13T01:48:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: cluster 1689212929.739733 mon.a (mon.0) 884 : cluster 0 osdmap e19: 12 total, 0 up, 9 in 2023-07-13T01:48:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7402794 mon.a (mon.0) 885 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.741395 mon.a (mon.0) 886 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7452164 mon.a (mon.0) 887 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7459342 mon.a (mon.0) 888 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7464514 mon.a (mon.0) 889 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7469716 mon.a (mon.0) 890 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7473588 mon.a (mon.0) 891 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.747731 mon.a (mon.0) 892 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7481008 mon.a (mon.0) 893 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7484837 mon.a (mon.0) 894 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.7487977 mon.a (mon.0) 895 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:49 smithi154 bash[27744]: audit 1689212929.749052 mon.a (mon.0) 896 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:50.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: cluster 1689212929.729657 mon.a (mon.0) 883 : cluster 1 Marking osd.2 out (has been down for 600 seconds) 2023-07-13T01:48:50.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: cluster 1689212929.739733 mon.a (mon.0) 884 : cluster 0 osdmap e19: 12 total, 0 up, 9 in 2023-07-13T01:48:50.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7402794 mon.a (mon.0) 885 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:50.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.741395 mon.a (mon.0) 886 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:50.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7452164 mon.a (mon.0) 887 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:50.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7459342 mon.a (mon.0) 888 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:50.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7464514 mon.a (mon.0) 889 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:50.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7469716 mon.a (mon.0) 890 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:50.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7473588 mon.a (mon.0) 891 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:50.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.747731 mon.a (mon.0) 892 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:50.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7481008 mon.a (mon.0) 893 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:50.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7484837 mon.a (mon.0) 894 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:50.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.7487977 mon.a (mon.0) 895 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:50.354 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:49 smithi103 bash[27315]: audit 1689212929.749052 mon.a (mon.0) 896 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: cluster 1689212929.729657 mon.a (mon.0) 883 : cluster 1 Marking osd.2 out (has been down for 600 seconds) 2023-07-13T01:48:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: cluster 1689212929.739733 mon.a (mon.0) 884 : cluster 0 osdmap e19: 12 total, 0 up, 9 in 2023-07-13T01:48:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7402794 mon.a (mon.0) 885 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.741395 mon.a (mon.0) 886 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7452164 mon.a (mon.0) 887 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7459342 mon.a (mon.0) 888 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:50.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7464514 mon.a (mon.0) 889 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:50.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7469716 mon.a (mon.0) 890 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:50.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7473588 mon.a (mon.0) 891 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:50.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.747731 mon.a (mon.0) 892 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:50.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7481008 mon.a (mon.0) 893 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:50.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7484837 mon.a (mon.0) 894 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:50.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.7487977 mon.a (mon.0) 895 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:50.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:49 smithi084 bash[27323]: audit 1689212929.749052 mon.a (mon.0) 896 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:50.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: cluster 1689212929.729657 mon.a (mon.0) 883 : cluster 1 Marking osd.2 out (has been down for 600 seconds) 2023-07-13T01:48:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: cluster 1689212929.739733 mon.a (mon.0) 884 : cluster 0 osdmap e19: 12 total, 0 up, 9 in 2023-07-13T01:48:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7402794 mon.a (mon.0) 885 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.741395 mon.a (mon.0) 886 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7452164 mon.a (mon.0) 887 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7459342 mon.a (mon.0) 888 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7464514 mon.a (mon.0) 889 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7469716 mon.a (mon.0) 890 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7473588 mon.a (mon.0) 891 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.747731 mon.a (mon.0) 892 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7481008 mon.a (mon.0) 893 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7484837 mon.a (mon.0) 894 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.7487977 mon.a (mon.0) 895 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:49 smithi022 bash[26979]: audit 1689212929.749052 mon.a (mon.0) 896 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:51.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:50 smithi154 bash[27744]: cluster 1689212929.9124832 mgr.a (mgr.14152) 621 : cluster 0 pgmap v511: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:51.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:48:50 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:48:51.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:50 smithi137 bash[27262]: cluster 1689212929.9124832 mgr.a (mgr.14152) 621 : cluster 0 pgmap v511: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:51.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:50 smithi103 bash[27315]: cluster 1689212929.9124832 mgr.a (mgr.14152) 621 : cluster 0 pgmap v511: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:51.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:50 smithi084 bash[27323]: cluster 1689212929.9124832 mgr.a (mgr.14152) 621 : cluster 0 pgmap v511: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:51.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:50 smithi022 bash[26979]: cluster 1689212929.9124832 mgr.a (mgr.14152) 621 : cluster 0 pgmap v511: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:53.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:53 smithi154 bash[27744]: cluster 1689212931.9131017 mgr.a (mgr.14152) 622 : cluster 0 pgmap v512: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:53.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:52 smithi137 bash[27262]: cluster 1689212931.9131017 mgr.a (mgr.14152) 622 : cluster 0 pgmap v512: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:52 smithi103 bash[27315]: cluster 1689212931.9131017 mgr.a (mgr.14152) 622 : cluster 0 pgmap v512: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:53.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:52 smithi084 bash[27323]: cluster 1689212931.9131017 mgr.a (mgr.14152) 622 : cluster 0 pgmap v512: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:52 smithi022 bash[26979]: cluster 1689212931.9131017 mgr.a (mgr.14152) 622 : cluster 0 pgmap v512: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:55.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:55 smithi154 bash[27744]: cluster 1689212933.9136949 mgr.a (mgr.14152) 623 : cluster 0 pgmap v513: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:55.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:55 smithi137 bash[27262]: cluster 1689212933.9136949 mgr.a (mgr.14152) 623 : cluster 0 pgmap v513: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:55.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:55 smithi103 bash[27315]: cluster 1689212933.9136949 mgr.a (mgr.14152) 623 : cluster 0 pgmap v513: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:55.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:55 smithi084 bash[27323]: cluster 1689212933.9136949 mgr.a (mgr.14152) 623 : cluster 0 pgmap v513: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:55.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:54 smithi022 bash[26979]: cluster 1689212933.9136949 mgr.a (mgr.14152) 623 : cluster 0 pgmap v513: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:56.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.111346 mon.a (mon.0) 897 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]: dispatch 2023-07-13T01:48:56.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1212187 mon.a (mon.0) 898 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]': finished 2023-07-13T01:48:56.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: cluster 1689212935.1213863 mon.a (mon.0) 899 : cluster 0 osdmap e20: 13 total, 0 up, 10 in 2023-07-13T01:48:56.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1216612 mon.a (mon.0) 900 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:56.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1222959 mon.a (mon.0) 901 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:56.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1226623 mon.a (mon.0) 902 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:56.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1230967 mon.a (mon.0) 903 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1235383 mon.a (mon.0) 904 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1239023 mon.a (mon.0) 905 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.124273 mon.a (mon.0) 906 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1246154 mon.a (mon.0) 907 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.125003 mon.a (mon.0) 908 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1253648 mon.a (mon.0) 909 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:56.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1257339 mon.a (mon.0) 910 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:56.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1260865 mon.a (mon.0) 911 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:56.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.1264462 mon.a (mon.0) 912 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:48:56.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:56 smithi154 bash[27744]: audit 1689212935.86295 mon.a (mon.0) 913 : audit 0 from='client.? 172.21.15.154:0/779918246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:48:56.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:56 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:48:56.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:56 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:56.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:56 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:56.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:56 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:48:56.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:56 smithi137 systemd[1]: Stopped Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:56.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:56 smithi137 systemd[1]: Started Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:48:56.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.111346 mon.a (mon.0) 897 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]: dispatch 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1212187 mon.a (mon.0) 898 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]': finished 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: cluster 1689212935.1213863 mon.a (mon.0) 899 : cluster 0 osdmap e20: 13 total, 0 up, 10 in 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1216612 mon.a (mon.0) 900 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1222959 mon.a (mon.0) 901 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1226623 mon.a (mon.0) 902 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1230967 mon.a (mon.0) 903 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:56.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1235383 mon.a (mon.0) 904 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1239023 mon.a (mon.0) 905 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.124273 mon.a (mon.0) 906 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1246154 mon.a (mon.0) 907 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.125003 mon.a (mon.0) 908 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1253648 mon.a (mon.0) 909 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1257339 mon.a (mon.0) 910 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:56.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1260865 mon.a (mon.0) 911 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:56.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.1264462 mon.a (mon.0) 912 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:48:56.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:56 smithi137 bash[27262]: audit 1689212935.86295 mon.a (mon.0) 913 : audit 0 from='client.? 172.21.15.154:0/779918246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:48:56.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.111346 mon.a (mon.0) 897 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]: dispatch 2023-07-13T01:48:56.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1212187 mon.a (mon.0) 898 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]': finished 2023-07-13T01:48:56.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: cluster 1689212935.1213863 mon.a (mon.0) 899 : cluster 0 osdmap e20: 13 total, 0 up, 10 in 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1216612 mon.a (mon.0) 900 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1222959 mon.a (mon.0) 901 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1226623 mon.a (mon.0) 902 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1230967 mon.a (mon.0) 903 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1235383 mon.a (mon.0) 904 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1239023 mon.a (mon.0) 905 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:56.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.124273 mon.a (mon.0) 906 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:56.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1246154 mon.a (mon.0) 907 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:56.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.125003 mon.a (mon.0) 908 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:56.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1253648 mon.a (mon.0) 909 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:56.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1257339 mon.a (mon.0) 910 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:56.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1260865 mon.a (mon.0) 911 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:56.352 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.1264462 mon.a (mon.0) 912 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:48:56.353 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:56 smithi103 bash[27315]: audit 1689212935.86295 mon.a (mon.0) 913 : audit 0 from='client.? 172.21.15.154:0/779918246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:48:56.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.111346 mon.a (mon.0) 897 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]: dispatch 2023-07-13T01:48:56.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1212187 mon.a (mon.0) 898 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]': finished 2023-07-13T01:48:56.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: cluster 1689212935.1213863 mon.a (mon.0) 899 : cluster 0 osdmap e20: 13 total, 0 up, 10 in 2023-07-13T01:48:56.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1216612 mon.a (mon.0) 900 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:56.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1222959 mon.a (mon.0) 901 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:56.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1226623 mon.a (mon.0) 902 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:56.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1230967 mon.a (mon.0) 903 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:56.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1235383 mon.a (mon.0) 904 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:56.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1239023 mon.a (mon.0) 905 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:56.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.124273 mon.a (mon.0) 906 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:56.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1246154 mon.a (mon.0) 907 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:56.393 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.125003 mon.a (mon.0) 908 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:56.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1253648 mon.a (mon.0) 909 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:56.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1257339 mon.a (mon.0) 910 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:56.394 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1260865 mon.a (mon.0) 911 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:56.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.1264462 mon.a (mon.0) 912 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:48:56.395 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:56 smithi084 bash[27323]: audit 1689212935.86295 mon.a (mon.0) 913 : audit 0 from='client.? 172.21.15.154:0/779918246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:48:56.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.111346 mon.a (mon.0) 897 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]: dispatch 2023-07-13T01:48:56.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1212187 mon.a (mon.0) 898 : audit 1 from='client.? 172.21.15.154:0/2543937296' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb3f8fdf-ab00-4b24-b781-7bd648b0e828"}]': finished 2023-07-13T01:48:56.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: cluster 1689212935.1213863 mon.a (mon.0) 899 : cluster 0 osdmap e20: 13 total, 0 up, 10 in 2023-07-13T01:48:56.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1216612 mon.a (mon.0) 900 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:48:56.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1222959 mon.a (mon.0) 901 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:48:56.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1226623 mon.a (mon.0) 902 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:48:56.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1230967 mon.a (mon.0) 903 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:48:56.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1235383 mon.a (mon.0) 904 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:48:56.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1239023 mon.a (mon.0) 905 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:48:56.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.124273 mon.a (mon.0) 906 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:48:56.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1246154 mon.a (mon.0) 907 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:48:56.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.125003 mon.a (mon.0) 908 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:48:56.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1253648 mon.a (mon.0) 909 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:48:56.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1257339 mon.a (mon.0) 910 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:48:56.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1260865 mon.a (mon.0) 911 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:48:56.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.1264462 mon.a (mon.0) 912 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:48:56.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:56 smithi022 bash[26979]: audit 1689212935.86295 mon.a (mon.0) 913 : audit 0 from='client.? 172.21.15.154:0/779918246' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:48:57.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:57 smithi084 bash[27323]: cluster 1689212935.914319 mgr.a (mgr.14152) 624 : cluster 0 pgmap v515: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:57.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:57 smithi022 bash[26979]: cluster 1689212935.914319 mgr.a (mgr.14152) 624 : cluster 0 pgmap v515: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:57.470 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[27262]: cluster 1689212935.914319 mgr.a (mgr.14152) 624 : cluster 0 pgmap v515: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:57.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:57 smithi154 bash[27744]: cluster 1689212935.914319 mgr.a (mgr.14152) 624 : cluster 0 pgmap v515: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:57.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:57 smithi103 bash[27315]: cluster 1689212935.914319 mgr.a (mgr.14152) 624 : cluster 0 pgmap v515: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:58.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45001]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:58.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45001]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:58.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45001]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:58.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45001]: --> Failed to activate any OSD(s) 2023-07-13T01:48:58.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45000]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:58.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45000]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:48:58.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45000]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:48:58.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:48:57 smithi137 bash[45000]: --> Failed to activate any OSD(s) 2023-07-13T01:48:59.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:48:59 smithi137 bash[27262]: cluster 1689212937.9151123 mgr.a (mgr.14152) 625 : cluster 0 pgmap v516: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:59.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:48:59 smithi084 bash[27323]: cluster 1689212937.9151123 mgr.a (mgr.14152) 625 : cluster 0 pgmap v516: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:59.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:48:59 smithi022 bash[26979]: cluster 1689212937.9151123 mgr.a (mgr.14152) 625 : cluster 0 pgmap v516: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:59.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:48:59 smithi154 bash[27744]: cluster 1689212937.9151123 mgr.a (mgr.14152) 625 : cluster 0 pgmap v516: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:48:59.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:48:59 smithi103 bash[27315]: cluster 1689212937.9151123 mgr.a (mgr.14152) 625 : cluster 0 pgmap v516: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:00.768 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:00 smithi137 bash[27262]: cluster 1689212939.9156353 mgr.a (mgr.14152) 626 : cluster 0 pgmap v517: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:00.769 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:00 smithi137 bash[45219]: debug 2023-07-13T01:49:00.612+0000 7fc9a802f700 1 -- 172.21.15.137:0/3966797866 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ba790c2d00 con 0x55ba79118800 2023-07-13T01:49:00.770 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:00 smithi137 bash[45219]: debug 2023-07-13T01:49:00.616+0000 7fc9b11b4640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:00.770 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:00 smithi137 bash[45187]: debug 2023-07-13T01:49:00.632+0000 7f5160dd2700 1 -- 172.21.15.137:0/3628552370 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56454887cd00 con 0x5645488d2800 2023-07-13T01:49:00.770 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:00 smithi137 bash[45187]: debug 2023-07-13T01:49:00.636+0000 7f5169f57640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:01.001 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:00 smithi154 bash[27744]: cluster 1689212939.9156353 mgr.a (mgr.14152) 626 : cluster 0 pgmap v517: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:00 smithi103 bash[27315]: cluster 1689212939.9156353 mgr.a (mgr.14152) 626 : cluster 0 pgmap v517: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:01.123 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:01 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:49:01.123 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:01 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:01.124 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:01 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:01.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:00 smithi084 bash[27323]: cluster 1689212939.9156353 mgr.a (mgr.14152) 626 : cluster 0 pgmap v517: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:01.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:00 smithi022 bash[26979]: cluster 1689212939.9156353 mgr.a (mgr.14152) 626 : cluster 0 pgmap v517: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:02.549 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:02 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:02.549 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:02 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:03.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:02 smithi154 bash[27744]: cluster 1689212941.9161377 mgr.a (mgr.14152) 627 : cluster 0 pgmap v518: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:03.263 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:02 smithi137 bash[27262]: cluster 1689212941.9161377 mgr.a (mgr.14152) 627 : cluster 0 pgmap v518: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:03.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:02 smithi103 bash[27315]: cluster 1689212941.9161377 mgr.a (mgr.14152) 627 : cluster 0 pgmap v518: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:03.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:02 smithi084 bash[27323]: cluster 1689212941.9161377 mgr.a (mgr.14152) 627 : cluster 0 pgmap v518: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:03.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:02 smithi022 bash[26979]: cluster 1689212941.9161377 mgr.a (mgr.14152) 627 : cluster 0 pgmap v518: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:04.049 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:03 smithi137 bash[45412]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:04.049 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:03 smithi137 bash[45412]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:04.049 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:03 smithi137 bash[45412]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:04.049 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:03 smithi137 bash[45412]: --> Failed to activate any OSD(s) 2023-07-13T01:49:05.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:04 smithi154 bash[27744]: cluster 1689212943.916663 mgr.a (mgr.14152) 628 : cluster 0 pgmap v519: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:05.264 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:04 smithi137 bash[27262]: cluster 1689212943.916663 mgr.a (mgr.14152) 628 : cluster 0 pgmap v519: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:05.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:04 smithi103 bash[27315]: cluster 1689212943.916663 mgr.a (mgr.14152) 628 : cluster 0 pgmap v519: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:05.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:04 smithi084 bash[27323]: cluster 1689212943.916663 mgr.a (mgr.14152) 628 : cluster 0 pgmap v519: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:05.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:04 smithi022 bash[26979]: cluster 1689212943.916663 mgr.a (mgr.14152) 628 : cluster 0 pgmap v519: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:06.951 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:06 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:49:06.951 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:06 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Failed with result 'exit-code'. 2023-07-13T01:49:07.219 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:06 smithi154 bash[27744]: cluster 1689212945.9172196 mgr.a (mgr.14152) 629 : cluster 0 pgmap v520: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:07.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:06 smithi137 bash[27262]: cluster 1689212945.9172196 mgr.a (mgr.14152) 629 : cluster 0 pgmap v520: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:07.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:06 smithi137 bash[45745]: debug 2023-07-13T01:49:06.960+0000 7f95605dd700 1 -- 172.21.15.137:0/1307910378 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561627588d00 con 0x5616275de800 2023-07-13T01:49:07.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:06 smithi137 bash[45745]: debug 2023-07-13T01:49:06.960+0000 7f9569762640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:07.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:06 smithi103 bash[27315]: cluster 1689212945.9172196 mgr.a (mgr.14152) 629 : cluster 0 pgmap v520: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:07.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:06 smithi084 bash[27323]: cluster 1689212945.9172196 mgr.a (mgr.14152) 629 : cluster 0 pgmap v520: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:07.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:06 smithi022 bash[26979]: cluster 1689212945.9172196 mgr.a (mgr.14152) 629 : cluster 0 pgmap v520: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:07.978 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:07 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:08.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:07 smithi137 bash[27262]: audit 1689212947.941269 mon.a (mon.0) 914 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.12"}]: dispatch 2023-07-13T01:49:08.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:07 smithi137 bash[27262]: audit 1689212947.943083 mon.a (mon.0) 915 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:08.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:07 smithi154 bash[27744]: audit 1689212947.941269 mon.a (mon.0) 914 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.12"}]: dispatch 2023-07-13T01:49:08.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:07 smithi154 bash[27744]: audit 1689212947.943083 mon.a (mon.0) 915 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:08.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:07 smithi103 bash[27315]: audit 1689212947.941269 mon.a (mon.0) 914 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.12"}]: dispatch 2023-07-13T01:49:08.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:07 smithi103 bash[27315]: audit 1689212947.943083 mon.a (mon.0) 915 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:08.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:07 smithi084 bash[27323]: audit 1689212947.941269 mon.a (mon.0) 914 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.12"}]: dispatch 2023-07-13T01:49:08.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:07 smithi084 bash[27323]: audit 1689212947.943083 mon.a (mon.0) 915 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:08.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:07 smithi022 bash[26979]: audit 1689212947.941269 mon.a (mon.0) 914 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.12"}]: dispatch 2023-07-13T01:49:08.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:07 smithi022 bash[26979]: audit 1689212947.943083 mon.a (mon.0) 915 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:09.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:08 smithi137 bash[27262]: cluster 1689212947.9177089 mgr.a (mgr.14152) 630 : cluster 0 pgmap v521: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:09.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:08 smithi137 bash[27262]: cephadm 1689212947.9447045 mgr.a (mgr.14152) 631 : cephadm 1 Deploying daemon osd.12 on smithi154 2023-07-13T01:49:09.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:08 smithi154 bash[27744]: cluster 1689212947.9177089 mgr.a (mgr.14152) 630 : cluster 0 pgmap v521: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:09.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:08 smithi154 bash[27744]: cephadm 1689212947.9447045 mgr.a (mgr.14152) 631 : cephadm 1 Deploying daemon osd.12 on smithi154 2023-07-13T01:49:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:08 smithi103 bash[27315]: cluster 1689212947.9177089 mgr.a (mgr.14152) 630 : cluster 0 pgmap v521: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:09.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:08 smithi103 bash[27315]: cephadm 1689212947.9447045 mgr.a (mgr.14152) 631 : cephadm 1 Deploying daemon osd.12 on smithi154 2023-07-13T01:49:09.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:08 smithi084 bash[27323]: cluster 1689212947.9177089 mgr.a (mgr.14152) 630 : cluster 0 pgmap v521: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:09.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:08 smithi084 bash[27323]: cephadm 1689212947.9447045 mgr.a (mgr.14152) 631 : cephadm 1 Deploying daemon osd.12 on smithi154 2023-07-13T01:49:09.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:08 smithi022 bash[26979]: cluster 1689212947.9177089 mgr.a (mgr.14152) 630 : cluster 0 pgmap v521: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:09.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:08 smithi022 bash[26979]: cephadm 1689212947.9447045 mgr.a (mgr.14152) 631 : cephadm 1 Deploying daemon osd.12 on smithi154 2023-07-13T01:49:10.298 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:09 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:49:11.000 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:10 smithi154 bash[27744]: cluster 1689212949.918233 mgr.a (mgr.14152) 632 : cluster 0 pgmap v522: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:11.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:10 smithi137 bash[27262]: cluster 1689212949.918233 mgr.a (mgr.14152) 632 : cluster 0 pgmap v522: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:11.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:10 smithi103 bash[27315]: cluster 1689212949.918233 mgr.a (mgr.14152) 632 : cluster 0 pgmap v522: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:11.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:10 smithi084 bash[27323]: cluster 1689212949.918233 mgr.a (mgr.14152) 632 : cluster 0 pgmap v522: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:11.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:10 smithi022 bash[26979]: cluster 1689212949.918233 mgr.a (mgr.14152) 632 : cluster 0 pgmap v522: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:13.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:12 smithi154 bash[27744]: cluster 1689212951.9187546 mgr.a (mgr.14152) 633 : cluster 0 pgmap v523: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:13.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:12 smithi154 bash[27744]: audit 1689212952.5077014 mon.a (mon.0) 916 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:12 smithi154 bash[27744]: audit 1689212952.508133 mon.a (mon.0) 917 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:13.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:12 smithi154 bash[27744]: audit 1689212952.51518 mon.a (mon.0) 918 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:12 smithi137 bash[27262]: cluster 1689212951.9187546 mgr.a (mgr.14152) 633 : cluster 0 pgmap v523: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:13.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:12 smithi137 bash[27262]: audit 1689212952.5077014 mon.a (mon.0) 916 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:12 smithi137 bash[27262]: audit 1689212952.508133 mon.a (mon.0) 917 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:13.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:12 smithi137 bash[27262]: audit 1689212952.51518 mon.a (mon.0) 918 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:12 smithi103 bash[27315]: cluster 1689212951.9187546 mgr.a (mgr.14152) 633 : cluster 0 pgmap v523: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:13.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:12 smithi103 bash[27315]: audit 1689212952.5077014 mon.a (mon.0) 916 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:12 smithi103 bash[27315]: audit 1689212952.508133 mon.a (mon.0) 917 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:13.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:12 smithi103 bash[27315]: audit 1689212952.51518 mon.a (mon.0) 918 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:12 smithi084 bash[27323]: cluster 1689212951.9187546 mgr.a (mgr.14152) 633 : cluster 0 pgmap v523: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:13.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:12 smithi084 bash[27323]: audit 1689212952.5077014 mon.a (mon.0) 916 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:12 smithi084 bash[27323]: audit 1689212952.508133 mon.a (mon.0) 917 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:13.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:12 smithi084 bash[27323]: audit 1689212952.51518 mon.a (mon.0) 918 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:12 smithi022 bash[26979]: cluster 1689212951.9187546 mgr.a (mgr.14152) 633 : cluster 0 pgmap v523: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:13.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:12 smithi022 bash[26979]: audit 1689212952.5077014 mon.a (mon.0) 916 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:13.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:12 smithi022 bash[26979]: audit 1689212952.508133 mon.a (mon.0) 917 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:13.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:12 smithi022 bash[26979]: audit 1689212952.51518 mon.a (mon.0) 918 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:15.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:14 smithi154 bash[27744]: cluster 1689212953.9192543 mgr.a (mgr.14152) 634 : cluster 0 pgmap v524: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:15.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:14 smithi137 bash[27262]: cluster 1689212953.9192543 mgr.a (mgr.14152) 634 : cluster 0 pgmap v524: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:15.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:14 smithi103 bash[27315]: cluster 1689212953.9192543 mgr.a (mgr.14152) 634 : cluster 0 pgmap v524: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:15.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:14 smithi084 bash[27323]: cluster 1689212953.9192543 mgr.a (mgr.14152) 634 : cluster 0 pgmap v524: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:15.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:14 smithi022 bash[26979]: cluster 1689212953.9192543 mgr.a (mgr.14152) 634 : cluster 0 pgmap v524: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:17.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:16 smithi154 bash[27744]: cluster 1689212955.9197562 mgr.a (mgr.14152) 635 : cluster 0 pgmap v525: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:17.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:16 smithi137 bash[27262]: cluster 1689212955.9197562 mgr.a (mgr.14152) 635 : cluster 0 pgmap v525: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:17.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:16 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 10. 2023-07-13T01:49:17.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:16 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:17.299 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:16 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:17.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:16 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:49:17.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:16 smithi137 systemd[1]: Stopped Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:17.300 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:16 smithi137 systemd[1]: Started Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:17.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:16 smithi103 bash[27315]: cluster 1689212955.9197562 mgr.a (mgr.14152) 635 : cluster 0 pgmap v525: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:17.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:16 smithi084 bash[27323]: cluster 1689212955.9197562 mgr.a (mgr.14152) 635 : cluster 0 pgmap v525: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:17.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:16 smithi022 bash[26979]: cluster 1689212955.9197562 mgr.a (mgr.14152) 635 : cluster 0 pgmap v525: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:19.049 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46085]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:19.049 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46085]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:19.049 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46085]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:19.050 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46085]: --> Failed to activate any OSD(s) 2023-07-13T01:49:19.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[27262]: cluster 1689212957.920289 mgr.a (mgr.14152) 636 : cluster 0 pgmap v526: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:19.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[27262]: audit 1689212957.954791 mon.a (mon.0) 919 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[27262]: audit 1689212957.9619553 mon.a (mon.0) 920 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[27262]: audit 1689212958.3813102 mon.a (mon.0) 921 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:19.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[27262]: audit 1689212958.3828664 mon.a (mon.0) 922 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:19.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[27262]: audit 1689212958.3928094 mon.a (mon.0) 923 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.052 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46084]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:19.053 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46084]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:19.053 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46084]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:19.053 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:18 smithi137 bash[46084]: --> Failed to activate any OSD(s) 2023-07-13T01:49:19.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:18 smithi154 bash[27744]: cluster 1689212957.920289 mgr.a (mgr.14152) 636 : cluster 0 pgmap v526: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:19.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:18 smithi154 bash[27744]: audit 1689212957.954791 mon.a (mon.0) 919 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:18 smithi154 bash[27744]: audit 1689212957.9619553 mon.a (mon.0) 920 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:18 smithi154 bash[27744]: audit 1689212958.3813102 mon.a (mon.0) 921 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:18 smithi154 bash[27744]: audit 1689212958.3828664 mon.a (mon.0) 922 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:19.254 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:18 smithi154 bash[27744]: audit 1689212958.3928094 mon.a (mon.0) 923 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:18 smithi103 bash[27315]: cluster 1689212957.920289 mgr.a (mgr.14152) 636 : cluster 0 pgmap v526: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:18 smithi103 bash[27315]: audit 1689212957.954791 mon.a (mon.0) 919 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:18 smithi103 bash[27315]: audit 1689212957.9619553 mon.a (mon.0) 920 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:18 smithi103 bash[27315]: audit 1689212958.3813102 mon.a (mon.0) 921 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:18 smithi103 bash[27315]: audit 1689212958.3828664 mon.a (mon.0) 922 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:18 smithi103 bash[27315]: audit 1689212958.3928094 mon.a (mon.0) 923 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:18 smithi084 bash[27323]: cluster 1689212957.920289 mgr.a (mgr.14152) 636 : cluster 0 pgmap v526: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:19.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:18 smithi084 bash[27323]: audit 1689212957.954791 mon.a (mon.0) 919 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:18 smithi084 bash[27323]: audit 1689212957.9619553 mon.a (mon.0) 920 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:18 smithi084 bash[27323]: audit 1689212958.3813102 mon.a (mon.0) 921 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:19.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:18 smithi084 bash[27323]: audit 1689212958.3828664 mon.a (mon.0) 922 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:19.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:18 smithi084 bash[27323]: audit 1689212958.3928094 mon.a (mon.0) 923 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:18 smithi022 bash[26979]: cluster 1689212957.920289 mgr.a (mgr.14152) 636 : cluster 0 pgmap v526: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:19.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:18 smithi022 bash[26979]: audit 1689212957.954791 mon.a (mon.0) 919 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:18 smithi022 bash[26979]: audit 1689212957.9619553 mon.a (mon.0) 920 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:19.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:18 smithi022 bash[26979]: audit 1689212958.3813102 mon.a (mon.0) 921 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:19.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:18 smithi022 bash[26979]: audit 1689212958.3828664 mon.a (mon.0) 922 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:19.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:18 smithi022 bash[26979]: audit 1689212958.3928094 mon.a (mon.0) 923 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:20.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:19 smithi154 bash[27744]: cluster 1689212958.3859622 mgr.a (mgr.14152) 637 : cluster 0 pgmap v527: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:19 smithi154 bash[27744]: cluster 1689212958.3862271 mgr.a (mgr.14152) 638 : cluster 0 pgmap v528: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:19 smithi154 bash[27744]: cluster 1689212958.9836032 mon.a (mon.0) 924 : cluster 3 Health check update: 12 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:49:20.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:19 smithi137 bash[27262]: cluster 1689212958.3859622 mgr.a (mgr.14152) 637 : cluster 0 pgmap v527: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:19 smithi137 bash[27262]: cluster 1689212958.3862271 mgr.a (mgr.14152) 638 : cluster 0 pgmap v528: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:19 smithi137 bash[27262]: cluster 1689212958.9836032 mon.a (mon.0) 924 : cluster 3 Health check update: 12 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:49:20.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:19 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:49:20.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:19 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:20.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:19 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:20.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:19 smithi103 bash[27315]: cluster 1689212958.3859622 mgr.a (mgr.14152) 637 : cluster 0 pgmap v527: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:19 smithi103 bash[27315]: cluster 1689212958.3862271 mgr.a (mgr.14152) 638 : cluster 0 pgmap v528: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:19 smithi103 bash[27315]: cluster 1689212958.9836032 mon.a (mon.0) 924 : cluster 3 Health check update: 12 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:49:20.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:19 smithi084 bash[27323]: cluster 1689212958.3859622 mgr.a (mgr.14152) 637 : cluster 0 pgmap v527: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:19 smithi084 bash[27323]: cluster 1689212958.3862271 mgr.a (mgr.14152) 638 : cluster 0 pgmap v528: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:19 smithi084 bash[27323]: cluster 1689212958.9836032 mon.a (mon.0) 924 : cluster 3 Health check update: 12 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:49:20.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:19 smithi022 bash[26979]: cluster 1689212958.3859622 mgr.a (mgr.14152) 637 : cluster 0 pgmap v527: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:19 smithi022 bash[26979]: cluster 1689212958.3862271 mgr.a (mgr.14152) 638 : cluster 0 pgmap v528: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:20.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:19 smithi022 bash[26979]: cluster 1689212958.9836032 mon.a (mon.0) 924 : cluster 3 Health check update: 12 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:49:21.732 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[46268]: debug 2023-07-13T01:49:21.612+0000 7ff4549c3700 1 -- 172.21.15.137:0/4038413894 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56226388ed00 con 0x5622638e4c00 2023-07-13T01:49:21.733 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[46268]: debug 2023-07-13T01:49:21.612+0000 7ff45db48640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:21.737 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 12 on host 'smithi154' 2023-07-13T01:49:21.998 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[27262]: cluster 1689212960.3867657 mgr.a (mgr.14152) 639 : cluster 0 pgmap v529: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:21.998 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[27262]: audit 1689212961.7004602 mon.a (mon.0) 925 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:21.999 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[27262]: audit 1689212961.7072709 mon.a (mon.0) 926 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:21.999 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[27262]: audit 1689212961.733978 mon.a (mon.0) 927 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:21.999 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[46320]: debug 2023-07-13T01:49:21.816+0000 7f154d2ff700 1 -- 172.21.15.137:0/3703559611 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a9ae678d00 con 0x55a9ae6ce800 2023-07-13T01:49:21.999 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:21 smithi137 bash[46320]: debug 2023-07-13T01:49:21.820+0000 7f1556484640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:22.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:21 smithi154 bash[27744]: cluster 1689212960.3867657 mgr.a (mgr.14152) 639 : cluster 0 pgmap v529: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:22.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:21 smithi154 bash[27744]: audit 1689212961.7004602 mon.a (mon.0) 925 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:21 smithi154 bash[27744]: audit 1689212961.7072709 mon.a (mon.0) 926 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:21 smithi154 bash[27744]: audit 1689212961.733978 mon.a (mon.0) 927 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:22.298 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:22 smithi137 bash[46336]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:22.298 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:22 smithi137 bash[46336]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:22.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:22 smithi137 bash[46336]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:22.299 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:22 smithi137 bash[46336]: --> Failed to activate any OSD(s) 2023-07-13T01:49:22.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:21 smithi103 bash[27315]: cluster 1689212960.3867657 mgr.a (mgr.14152) 639 : cluster 0 pgmap v529: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:22.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:21 smithi103 bash[27315]: audit 1689212961.7004602 mon.a (mon.0) 925 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:21 smithi103 bash[27315]: audit 1689212961.7072709 mon.a (mon.0) 926 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:21 smithi103 bash[27315]: audit 1689212961.733978 mon.a (mon.0) 927 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:22.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:21 smithi084 bash[27323]: cluster 1689212960.3867657 mgr.a (mgr.14152) 639 : cluster 0 pgmap v529: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:22.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:21 smithi084 bash[27323]: audit 1689212961.7004602 mon.a (mon.0) 925 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:21 smithi084 bash[27323]: audit 1689212961.7072709 mon.a (mon.0) 926 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:21 smithi084 bash[27323]: audit 1689212961.733978 mon.a (mon.0) 927 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:22.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:21 smithi022 bash[26979]: cluster 1689212960.3867657 mgr.a (mgr.14152) 639 : cluster 0 pgmap v529: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:22.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:21 smithi022 bash[26979]: audit 1689212961.7004602 mon.a (mon.0) 925 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:21 smithi022 bash[26979]: audit 1689212961.7072709 mon.a (mon.0) 926 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:22.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:21 smithi022 bash[26979]: audit 1689212961.733978 mon.a (mon.0) 927 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:49:22.469 DEBUG:teuthology.orchestra.run.smithi154:osd.12> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service 2023-07-13T01:49:22.471 INFO:tasks.cephadm:Deploying osd.13 on smithi154 with /dev/vg_nvme/lv_3... 2023-07-13T01:49:22.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-13T01:49:22.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:49:22.814 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:22 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:23.798 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:23 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:24.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:23 smithi154 bash[27744]: cluster 1689212962.3874252 mgr.a (mgr.14152) 640 : cluster 0 pgmap v530: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:24.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:23 smithi137 bash[27262]: cluster 1689212962.3874252 mgr.a (mgr.14152) 640 : cluster 0 pgmap v530: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:24.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:23 smithi103 bash[27315]: cluster 1689212962.3874252 mgr.a (mgr.14152) 640 : cluster 0 pgmap v530: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:24.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:23 smithi084 bash[27323]: cluster 1689212962.3874252 mgr.a (mgr.14152) 640 : cluster 0 pgmap v530: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:24.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:23 smithi022 bash[26979]: cluster 1689212962.3874252 mgr.a (mgr.14152) 640 : cluster 0 pgmap v530: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:26.217 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:25 smithi137 bash[27262]: cluster 1689212964.3880665 mgr.a (mgr.14152) 641 : cluster 0 pgmap v531: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:26.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:25 smithi154 bash[27744]: cluster 1689212964.3880665 mgr.a (mgr.14152) 641 : cluster 0 pgmap v531: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:26.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:25 smithi103 bash[27315]: cluster 1689212964.3880665 mgr.a (mgr.14152) 641 : cluster 0 pgmap v531: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:26.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:25 smithi084 bash[27323]: cluster 1689212964.3880665 mgr.a (mgr.14152) 641 : cluster 0 pgmap v531: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:26.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:25 smithi022 bash[26979]: cluster 1689212964.3880665 mgr.a (mgr.14152) 641 : cluster 0 pgmap v531: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:26.519 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:26 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Failed with result 'exit-code'. 2023-07-13T01:49:26.520 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:26 smithi137 bash[46677]: debug 2023-07-13T01:49:26.316+0000 7fd1ebb93700 1 -- 172.21.15.137:0/1157786178 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55916dd1ed00 con 0x55916dd74800 2023-07-13T01:49:26.520 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:26 smithi137 bash[46677]: debug 2023-07-13T01:49:26.316+0000 7fd1f4d18640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:26.587 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:49:27.298 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:27 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:28.155 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:27 smithi154 bash[27744]: cluster 1689212966.3886318 mgr.a (mgr.14152) 642 : cluster 0 pgmap v532: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:28.155 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:27 smithi154 bash[27744]: audit 1689212967.2840855 mon.a (mon.0) 928 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.155 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:27 smithi154 bash[27744]: audit 1689212967.2918785 mon.a (mon.0) 929 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.298 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:27 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:49:28.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:27 smithi137 bash[27262]: cluster 1689212966.3886318 mgr.a (mgr.14152) 642 : cluster 0 pgmap v532: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:28.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:27 smithi137 bash[27262]: audit 1689212967.2840855 mon.a (mon.0) 928 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:27 smithi137 bash[27262]: audit 1689212967.2918785 mon.a (mon.0) 929 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:27 smithi103 bash[27315]: cluster 1689212966.3886318 mgr.a (mgr.14152) 642 : cluster 0 pgmap v532: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:28.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:27 smithi103 bash[27315]: audit 1689212967.2840855 mon.a (mon.0) 928 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:27 smithi103 bash[27315]: audit 1689212967.2918785 mon.a (mon.0) 929 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:27 smithi084 bash[27323]: cluster 1689212966.3886318 mgr.a (mgr.14152) 642 : cluster 0 pgmap v532: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:28.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:27 smithi084 bash[27323]: audit 1689212967.2840855 mon.a (mon.0) 928 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:27 smithi084 bash[27323]: audit 1689212967.2918785 mon.a (mon.0) 929 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:27 smithi022 bash[26979]: cluster 1689212966.3886318 mgr.a (mgr.14152) 642 : cluster 0 pgmap v532: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:28.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:27 smithi022 bash[26979]: audit 1689212967.2840855 mon.a (mon.0) 928 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:27 smithi022 bash[26979]: audit 1689212967.2918785 mon.a (mon.0) 929 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:28.764 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:28 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:49:28.764 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:28 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:28.764 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:28 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:29.798 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:29 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:49:30.000 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:29 smithi154 bash[27744]: cluster 1689212968.389134 mgr.a (mgr.14152) 643 : cluster 0 pgmap v533: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:30.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:29 smithi137 bash[27262]: cluster 1689212968.389134 mgr.a (mgr.14152) 643 : cluster 0 pgmap v533: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:30.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:29 smithi103 bash[27315]: cluster 1689212968.389134 mgr.a (mgr.14152) 643 : cluster 0 pgmap v533: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:30.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:29 smithi084 bash[27323]: cluster 1689212968.389134 mgr.a (mgr.14152) 643 : cluster 0 pgmap v533: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:30.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:29 smithi022 bash[26979]: cluster 1689212968.389134 mgr.a (mgr.14152) 643 : cluster 0 pgmap v533: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:31.131 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:30 smithi154 bash[32675]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:31.131 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:30 smithi154 bash[32675]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:31.131 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:30 smithi154 bash[32675]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:31.131 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:30 smithi154 bash[32675]: --> Failed to activate any OSD(s) 2023-07-13T01:49:32.026 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:31 smithi154 bash[27744]: cluster 1689212970.3896475 mgr.a (mgr.14152) 644 : cluster 0 pgmap v534: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:32.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:31 smithi137 bash[27262]: cluster 1689212970.3896475 mgr.a (mgr.14152) 644 : cluster 0 pgmap v534: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:32.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:31 smithi103 bash[27315]: cluster 1689212970.3896475 mgr.a (mgr.14152) 644 : cluster 0 pgmap v534: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:32.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:31 smithi084 bash[27323]: cluster 1689212970.3896475 mgr.a (mgr.14152) 644 : cluster 0 pgmap v534: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:32.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:31 smithi022 bash[26979]: cluster 1689212970.3896475 mgr.a (mgr.14152) 644 : cluster 0 pgmap v534: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:32.495 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-13T01:49:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-13T01:49:32.496 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2023-07-13T01:49:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2023-07-13T01:49:32.496 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0167203 s, 627 MB/s 2023-07-13T01:49:32.496 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2023-07-13T01:49:33.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2023-07-13T01:49:34.136 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[33514]: debug 2023-07-13T01:49:33.959+0000 7f6404ad3700 1 -- 172.21.15.154:0/2204290735 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5579c19dad00 con 0x5579c1a30800 2023-07-13T01:49:34.136 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[33514]: debug 2023-07-13T01:49:33.959+0000 7f640dc58640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: cluster 1689212972.390194 mgr.a (mgr.14152) 645 : cluster 0 pgmap v535: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.5046258 mon.a (mon.0) 930 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.511718 mon.a (mon.0) 931 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.5132298 mon.a (mon.0) 932 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.520782 mon.a (mon.0) 933 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.5224674 mon.a (mon.0) 934 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:34.137 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.5237343 mon.a (mon.0) 935 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:34.138 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:33 smithi154 bash[27744]: audit 1689212973.5323439 mon.a (mon.0) 936 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: cluster 1689212972.390194 mgr.a (mgr.14152) 645 : cluster 0 pgmap v535: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.5046258 mon.a (mon.0) 930 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.511718 mon.a (mon.0) 931 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.5132298 mon.a (mon.0) 932 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.520782 mon.a (mon.0) 933 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.5224674 mon.a (mon.0) 934 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.5237343 mon.a (mon.0) 935 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:34.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:33 smithi137 bash[27262]: audit 1689212973.5323439 mon.a (mon.0) 936 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: cluster 1689212972.390194 mgr.a (mgr.14152) 645 : cluster 0 pgmap v535: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:34.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.5046258 mon.a (mon.0) 930 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.511718 mon.a (mon.0) 931 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.5132298 mon.a (mon.0) 932 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:49:34.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.520782 mon.a (mon.0) 933 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.5224674 mon.a (mon.0) 934 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:34.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.5237343 mon.a (mon.0) 935 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:34.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:33 smithi103 bash[27315]: audit 1689212973.5323439 mon.a (mon.0) 936 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: cluster 1689212972.390194 mgr.a (mgr.14152) 645 : cluster 0 pgmap v535: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:34.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.5046258 mon.a (mon.0) 930 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.511718 mon.a (mon.0) 931 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.5132298 mon.a (mon.0) 932 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:49:34.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.520782 mon.a (mon.0) 933 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.5224674 mon.a (mon.0) 934 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:34.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.5237343 mon.a (mon.0) 935 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:34.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:33 smithi084 bash[27323]: audit 1689212973.5323439 mon.a (mon.0) 936 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: cluster 1689212972.390194 mgr.a (mgr.14152) 645 : cluster 0 pgmap v535: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:34.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.5046258 mon.a (mon.0) 930 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.511718 mon.a (mon.0) 931 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.5132298 mon.a (mon.0) 932 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:49:34.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.520782 mon.a (mon.0) 933 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.5224674 mon.a (mon.0) 934 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:34.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.5237343 mon.a (mon.0) 935 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:49:34.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:33 smithi022 bash[26979]: audit 1689212973.5323439 mon.a (mon.0) 936 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:49:34.975 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:34 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:35.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:34 smithi154 bash[27744]: cephadm 1689212973.4943013 mgr.a (mgr.14152) 646 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:49:35.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:34 smithi154 bash[27744]: cephadm 1689212973.5143015 mgr.a (mgr.14152) 647 : cephadm 1 Adjusting osd_memory_target on smithi154 to 17265M 2023-07-13T01:49:35.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:34 smithi154 bash[27744]: cluster 1689212973.5261557 mgr.a (mgr.14152) 648 : cluster 0 pgmap v536: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:34 smithi154 bash[27744]: cluster 1689212973.5264375 mgr.a (mgr.14152) 649 : cluster 0 pgmap v537: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:34 smithi137 bash[27262]: cephadm 1689212973.4943013 mgr.a (mgr.14152) 646 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:49:35.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:34 smithi137 bash[27262]: cephadm 1689212973.5143015 mgr.a (mgr.14152) 647 : cephadm 1 Adjusting osd_memory_target on smithi154 to 17265M 2023-07-13T01:49:35.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:34 smithi137 bash[27262]: cluster 1689212973.5261557 mgr.a (mgr.14152) 648 : cluster 0 pgmap v536: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:34 smithi137 bash[27262]: cluster 1689212973.5264375 mgr.a (mgr.14152) 649 : cluster 0 pgmap v537: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:34 smithi103 bash[27315]: cephadm 1689212973.4943013 mgr.a (mgr.14152) 646 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:49:35.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:34 smithi103 bash[27315]: cephadm 1689212973.5143015 mgr.a (mgr.14152) 647 : cephadm 1 Adjusting osd_memory_target on smithi154 to 17265M 2023-07-13T01:49:35.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:34 smithi103 bash[27315]: cluster 1689212973.5261557 mgr.a (mgr.14152) 648 : cluster 0 pgmap v536: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:34 smithi103 bash[27315]: cluster 1689212973.5264375 mgr.a (mgr.14152) 649 : cluster 0 pgmap v537: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:34 smithi084 bash[27323]: cephadm 1689212973.4943013 mgr.a (mgr.14152) 646 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:49:35.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:34 smithi084 bash[27323]: cephadm 1689212973.5143015 mgr.a (mgr.14152) 647 : cephadm 1 Adjusting osd_memory_target on smithi154 to 17265M 2023-07-13T01:49:35.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:34 smithi084 bash[27323]: cluster 1689212973.5261557 mgr.a (mgr.14152) 648 : cluster 0 pgmap v536: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:34 smithi084 bash[27323]: cluster 1689212973.5264375 mgr.a (mgr.14152) 649 : cluster 0 pgmap v537: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:34 smithi022 bash[26979]: cephadm 1689212973.4943013 mgr.a (mgr.14152) 646 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:49:35.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:34 smithi022 bash[26979]: cephadm 1689212973.5143015 mgr.a (mgr.14152) 647 : cephadm 1 Adjusting osd_memory_target on smithi154 to 17265M 2023-07-13T01:49:35.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:34 smithi022 bash[26979]: cluster 1689212973.5261557 mgr.a (mgr.14152) 648 : cluster 0 pgmap v536: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:35.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:34 smithi022 bash[26979]: cluster 1689212973.5264375 mgr.a (mgr.14152) 649 : cluster 0 pgmap v537: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:36.798 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:36 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:49:36.798 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:36 smithi137 systemd[1]: Stopped Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:36.798 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:36 smithi137 systemd[1]: Started Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:37.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:36 smithi154 bash[27744]: cluster 1689212975.526918 mgr.a (mgr.14152) 650 : cluster 0 pgmap v538: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:37.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:36 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:49:37.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:36 smithi137 bash[27262]: cluster 1689212975.526918 mgr.a (mgr.14152) 650 : cluster 0 pgmap v538: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:37.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:36 smithi103 bash[27315]: cluster 1689212975.526918 mgr.a (mgr.14152) 650 : cluster 0 pgmap v538: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:37.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:36 smithi084 bash[27323]: cluster 1689212975.526918 mgr.a (mgr.14152) 650 : cluster 0 pgmap v538: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:37.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:36 smithi022 bash[26979]: cluster 1689212975.526918 mgr.a (mgr.14152) 650 : cluster 0 pgmap v538: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:38.048 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:37 smithi137 bash[47141]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:38.048 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:37 smithi137 bash[47141]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:38.048 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:37 smithi137 bash[47141]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:38.048 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:37 smithi137 bash[47141]: --> Failed to activate any OSD(s) 2023-07-13T01:49:38.214 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:38 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 11. 2023-07-13T01:49:38.214 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:38 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:38.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:38 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:39.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:39 smithi154 bash[27744]: cluster 1689212977.5273564 mgr.a (mgr.14152) 651 : cluster 0 pgmap v539: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:39.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:38 smithi137 bash[27262]: cluster 1689212977.5273564 mgr.a (mgr.14152) 651 : cluster 0 pgmap v539: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:39.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:38 smithi103 bash[27315]: cluster 1689212977.5273564 mgr.a (mgr.14152) 651 : cluster 0 pgmap v539: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:39.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:38 smithi084 bash[27323]: cluster 1689212977.5273564 mgr.a (mgr.14152) 651 : cluster 0 pgmap v539: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:39.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:38 smithi022 bash[26979]: cluster 1689212977.5273564 mgr.a (mgr.14152) 651 : cluster 0 pgmap v539: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:39.847 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:49:40.009 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:39 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:49:40.010 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:39 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:40.010 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:39 smithi137 systemd[1]: Started Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:40.800 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:40 smithi137 bash[47245]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:40.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:40 smithi137 bash[47245]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:40.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:40 smithi137 bash[47245]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:40.801 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:40 smithi137 bash[47245]: --> Failed to activate any OSD(s) 2023-07-13T01:49:41.111 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:41 smithi154 bash[27744]: cluster 1689212979.5278666 mgr.a (mgr.14152) 652 : cluster 0 pgmap v540: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:41.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:41 smithi137 bash[27262]: cluster 1689212979.5278666 mgr.a (mgr.14152) 652 : cluster 0 pgmap v540: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:41.298 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:41 smithi137 bash[47279]: debug 2023-07-13T01:49:41.120+0000 7fd4915f6700 1 -- 172.21.15.137:0/1632795958 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555950aaad00 con 0x555950b00c00 2023-07-13T01:49:41.298 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:41 smithi137 bash[47279]: debug 2023-07-13T01:49:41.124+0000 7fd49a77b640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:41.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:41 smithi103 bash[27315]: cluster 1689212979.5278666 mgr.a (mgr.14152) 652 : cluster 0 pgmap v540: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:41.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:41 smithi084 bash[27323]: cluster 1689212979.5278666 mgr.a (mgr.14152) 652 : cluster 0 pgmap v540: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:41.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:40 smithi022 bash[26979]: cluster 1689212979.5278666 mgr.a (mgr.14152) 652 : cluster 0 pgmap v540: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:43.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:43 smithi137 bash[27262]: cluster 1689212981.528394 mgr.a (mgr.14152) 653 : cluster 0 pgmap v541: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:43.049 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:42 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:43.049 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:42 smithi137 bash[47314]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:43.050 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:42 smithi137 bash[47314]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:43.050 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:42 smithi137 bash[47314]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:43.050 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:42 smithi137 bash[47314]: --> Failed to activate any OSD(s) 2023-07-13T01:49:43.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:43 smithi154 bash[27744]: cluster 1689212981.528394 mgr.a (mgr.14152) 653 : cluster 0 pgmap v541: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:43.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:43 smithi103 bash[27315]: cluster 1689212981.528394 mgr.a (mgr.14152) 653 : cluster 0 pgmap v541: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:43.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:43 smithi084 bash[27323]: cluster 1689212981.528394 mgr.a (mgr.14152) 653 : cluster 0 pgmap v541: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:43.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:43 smithi022 bash[26979]: cluster 1689212981.528394 mgr.a (mgr.14152) 653 : cluster 0 pgmap v541: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:44.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:44 smithi137 bash[27262]: audit 1689212982.9998074 mgr.a (mgr.14152) 654 : audit 0 from='client.24671 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:49:44.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:44 smithi137 bash[27262]: audit 1689212983.0088875 mon.a (mon.0) 937 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:49:44.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:44 smithi137 bash[27262]: audit 1689212983.0138984 mon.a (mon.0) 938 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:49:44.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:44 smithi137 bash[27262]: audit 1689212983.0152783 mon.a (mon.0) 939 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:44.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:44 smithi103 bash[27315]: audit 1689212982.9998074 mgr.a (mgr.14152) 654 : audit 0 from='client.24671 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:49:44.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:44 smithi103 bash[27315]: audit 1689212983.0088875 mon.a (mon.0) 937 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:49:44.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:44 smithi103 bash[27315]: audit 1689212983.0138984 mon.a (mon.0) 938 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:49:44.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:44 smithi103 bash[27315]: audit 1689212983.0152783 mon.a (mon.0) 939 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:44.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:44 smithi084 bash[27323]: audit 1689212982.9998074 mgr.a (mgr.14152) 654 : audit 0 from='client.24671 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:49:44.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:44 smithi084 bash[27323]: audit 1689212983.0088875 mon.a (mon.0) 937 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:49:44.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:44 smithi084 bash[27323]: audit 1689212983.0138984 mon.a (mon.0) 938 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:49:44.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:44 smithi084 bash[27323]: audit 1689212983.0152783 mon.a (mon.0) 939 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:44 smithi022 bash[26979]: audit 1689212982.9998074 mgr.a (mgr.14152) 654 : audit 0 from='client.24671 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:49:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:44 smithi022 bash[26979]: audit 1689212983.0088875 mon.a (mon.0) 937 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:49:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:44 smithi022 bash[26979]: audit 1689212983.0138984 mon.a (mon.0) 938 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:49:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:44 smithi022 bash[26979]: audit 1689212983.0152783 mon.a (mon.0) 939 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:44 smithi154 bash[27744]: audit 1689212982.9998074 mgr.a (mgr.14152) 654 : audit 0 from='client.24671 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:49:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:44 smithi154 bash[27744]: audit 1689212983.0088875 mon.a (mon.0) 937 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:49:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:44 smithi154 bash[27744]: audit 1689212983.0138984 mon.a (mon.0) 938 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:49:44.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:44 smithi154 bash[27744]: audit 1689212983.0152783 mon.a (mon.0) 939 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:49:44.777 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:44 smithi137 bash[47494]: debug 2023-07-13T01:49:44.468+0000 7fee03d33700 1 -- 172.21.15.137:0/1440080550 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555db9af6d00 con 0x555db9b4c800 2023-07-13T01:49:44.777 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:44 smithi137 bash[47494]: debug 2023-07-13T01:49:44.468+0000 7fee0ceb8640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:45.095 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:45 smithi137 bash[27262]: cluster 1689212983.5288882 mgr.a (mgr.14152) 655 : cluster 0 pgmap v542: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:45.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:45 smithi103 bash[27315]: cluster 1689212983.5288882 mgr.a (mgr.14152) 655 : cluster 0 pgmap v542: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:45.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:45 smithi084 bash[27323]: cluster 1689212983.5288882 mgr.a (mgr.14152) 655 : cluster 0 pgmap v542: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:45.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:45 smithi022 bash[26979]: cluster 1689212983.5288882 mgr.a (mgr.14152) 655 : cluster 0 pgmap v542: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:45.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:45 smithi154 bash[27744]: cluster 1689212983.5288882 mgr.a (mgr.14152) 655 : cluster 0 pgmap v542: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:46.645 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:46 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:46.979 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:46 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Failed with result 'exit-code'. 2023-07-13T01:49:47.240 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:47 smithi137 bash[47710]: debug 2023-07-13T01:49:47.108+0000 7f2227d51700 1 -- 172.21.15.137:0/463595946 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562512b68d00 con 0x562512bbe800 2023-07-13T01:49:47.240 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:47 smithi137 bash[47710]: debug 2023-07-13T01:49:47.108+0000 7f2230ed6640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:47.240 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:47 smithi137 bash[27262]: cluster 1689212985.529395 mgr.a (mgr.14152) 656 : cluster 0 pgmap v543: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:47.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:47 smithi103 bash[27315]: cluster 1689212985.529395 mgr.a (mgr.14152) 656 : cluster 0 pgmap v543: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:47.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:47 smithi084 bash[27323]: cluster 1689212985.529395 mgr.a (mgr.14152) 656 : cluster 0 pgmap v543: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:47.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:47 smithi022 bash[26979]: cluster 1689212985.529395 mgr.a (mgr.14152) 656 : cluster 0 pgmap v543: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:47.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:47 smithi154 bash[27744]: cluster 1689212985.529395 mgr.a (mgr.14152) 656 : cluster 0 pgmap v543: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:47.502 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:47 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:49:47.502 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:47 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:47.502 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:47 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:48.547 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:48 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:48.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:48 smithi154 bash[34176]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:48.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:48 smithi154 bash[34176]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:49:48.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:48 smithi154 bash[34176]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:49:48.751 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:48 smithi154 bash[34176]: --> Failed to activate any OSD(s) 2023-07-13T01:49:49.173 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:49 smithi137 bash[27262]: cluster 1689212987.529933 mgr.a (mgr.14152) 657 : cluster 0 pgmap v544: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:49.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:49 smithi154 bash[27744]: cluster 1689212987.529933 mgr.a (mgr.14152) 657 : cluster 0 pgmap v544: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:49.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:49 smithi103 bash[27315]: cluster 1689212987.529933 mgr.a (mgr.14152) 657 : cluster 0 pgmap v544: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:49.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:49 smithi084 bash[27323]: cluster 1689212987.529933 mgr.a (mgr.14152) 657 : cluster 0 pgmap v544: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:49.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:49 smithi022 bash[26979]: cluster 1689212987.529933 mgr.a (mgr.14152) 657 : cluster 0 pgmap v544: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:50.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: cluster 1689212989.7616959 mon.a (mon.0) 940 : cluster 1 Marking osd.3 out (has been down for 601 seconds) 2023-07-13T01:49:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: cluster 1689212989.7701585 mon.a (mon.0) 941 : cluster 0 osdmap e21: 13 total, 0 up, 9 in 2023-07-13T01:49:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7706962 mon.a (mon.0) 942 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.771179 mon.a (mon.0) 943 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7715223 mon.a (mon.0) 944 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7718205 mon.a (mon.0) 945 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:50.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7721214 mon.a (mon.0) 946 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7724998 mon.a (mon.0) 947 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.773021 mon.a (mon.0) 948 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7734125 mon.a (mon.0) 949 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.773838 mon.a (mon.0) 950 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.777377 mon.a (mon.0) 951 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.777697 mon.a (mon.0) 952 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:50.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7779243 mon.a (mon.0) 953 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:50.253 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:50 smithi154 bash[27744]: audit 1689212989.7781434 mon.a (mon.0) 954 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:50.298 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:49:49 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:49:50.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: cluster 1689212989.7616959 mon.a (mon.0) 940 : cluster 1 Marking osd.3 out (has been down for 601 seconds) 2023-07-13T01:49:50.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: cluster 1689212989.7701585 mon.a (mon.0) 941 : cluster 0 osdmap e21: 13 total, 0 up, 9 in 2023-07-13T01:49:50.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7706962 mon.a (mon.0) 942 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:50.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.771179 mon.a (mon.0) 943 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:50.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7715223 mon.a (mon.0) 944 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:50.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7718205 mon.a (mon.0) 945 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:50.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7721214 mon.a (mon.0) 946 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:50.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7724998 mon.a (mon.0) 947 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:50.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.773021 mon.a (mon.0) 948 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:50.301 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7734125 mon.a (mon.0) 949 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:50.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.773838 mon.a (mon.0) 950 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:50.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.777377 mon.a (mon.0) 951 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:50.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.777697 mon.a (mon.0) 952 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:50.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7779243 mon.a (mon.0) 953 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:50.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:50 smithi137 bash[27262]: audit 1689212989.7781434 mon.a (mon.0) 954 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:50.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: cluster 1689212989.7616959 mon.a (mon.0) 940 : cluster 1 Marking osd.3 out (has been down for 601 seconds) 2023-07-13T01:49:50.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: cluster 1689212989.7701585 mon.a (mon.0) 941 : cluster 0 osdmap e21: 13 total, 0 up, 9 in 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7706962 mon.a (mon.0) 942 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.771179 mon.a (mon.0) 943 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7715223 mon.a (mon.0) 944 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7718205 mon.a (mon.0) 945 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7721214 mon.a (mon.0) 946 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7724998 mon.a (mon.0) 947 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:50.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.773021 mon.a (mon.0) 948 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:50.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7734125 mon.a (mon.0) 949 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:50.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.773838 mon.a (mon.0) 950 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:50.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.777377 mon.a (mon.0) 951 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:50.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.777697 mon.a (mon.0) 952 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:50.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7779243 mon.a (mon.0) 953 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:50.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:50 smithi103 bash[27315]: audit 1689212989.7781434 mon.a (mon.0) 954 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:50.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: cluster 1689212989.7616959 mon.a (mon.0) 940 : cluster 1 Marking osd.3 out (has been down for 601 seconds) 2023-07-13T01:49:50.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: cluster 1689212989.7701585 mon.a (mon.0) 941 : cluster 0 osdmap e21: 13 total, 0 up, 9 in 2023-07-13T01:49:50.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7706962 mon.a (mon.0) 942 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:50.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.771179 mon.a (mon.0) 943 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7715223 mon.a (mon.0) 944 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7718205 mon.a (mon.0) 945 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7721214 mon.a (mon.0) 946 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7724998 mon.a (mon.0) 947 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.773021 mon.a (mon.0) 948 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7734125 mon.a (mon.0) 949 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.773838 mon.a (mon.0) 950 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:50.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.777377 mon.a (mon.0) 951 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.777697 mon.a (mon.0) 952 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7779243 mon.a (mon.0) 953 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:50.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:50 smithi084 bash[27323]: audit 1689212989.7781434 mon.a (mon.0) 954 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:50.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: cluster 1689212989.7616959 mon.a (mon.0) 940 : cluster 1 Marking osd.3 out (has been down for 601 seconds) 2023-07-13T01:49:50.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: cluster 1689212989.7701585 mon.a (mon.0) 941 : cluster 0 osdmap e21: 13 total, 0 up, 9 in 2023-07-13T01:49:50.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7706962 mon.a (mon.0) 942 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.771179 mon.a (mon.0) 943 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7715223 mon.a (mon.0) 944 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:50.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7718205 mon.a (mon.0) 945 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7721214 mon.a (mon.0) 946 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7724998 mon.a (mon.0) 947 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:50.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.773021 mon.a (mon.0) 948 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:50.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7734125 mon.a (mon.0) 949 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:50.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.773838 mon.a (mon.0) 950 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:50.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.777377 mon.a (mon.0) 951 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:50.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.777697 mon.a (mon.0) 952 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:50.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7779243 mon.a (mon.0) 953 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:50.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:50 smithi022 bash[26979]: audit 1689212989.7781434 mon.a (mon.0) 954 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:51.291 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:51 smithi154 bash[27744]: cluster 1689212989.530472 mgr.a (mgr.14152) 658 : cluster 0 pgmap v545: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:51.297 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:49:51 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:49:51.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:51 smithi137 bash[27262]: cluster 1689212989.530472 mgr.a (mgr.14152) 658 : cluster 0 pgmap v545: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:51.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:51 smithi103 bash[27315]: cluster 1689212989.530472 mgr.a (mgr.14152) 658 : cluster 0 pgmap v545: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:51.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:51 smithi084 bash[27323]: cluster 1689212989.530472 mgr.a (mgr.14152) 658 : cluster 0 pgmap v545: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:51.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:51 smithi022 bash[26979]: cluster 1689212989.530472 mgr.a (mgr.14152) 658 : cluster 0 pgmap v545: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:51.617 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:51 smithi154 bash[34361]: debug 2023-07-13T01:49:51.367+0000 7f4b1ffbc700 1 -- 172.21.15.154:0/95015664 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56021fb02d00 con 0x56021fb58800 2023-07-13T01:49:51.617 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:51 smithi154 bash[34361]: debug 2023-07-13T01:49:51.367+0000 7f4b29141640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:49:52.500 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:52 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:49:53.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: cluster 1689212991.5310159 mgr.a (mgr.14152) 659 : cluster 0 pgmap v547: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:53.298 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5077941 mon.a (mon.0) 955 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5143576 mon.e (mon.1) 12 : audit 1 from='client.? 172.21.15.154:0/1469862130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5176048 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]': finished 2023-07-13T01:49:53.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: cluster 1689212992.517728 mon.a (mon.0) 957 : cluster 0 osdmap e22: 14 total, 0 up, 10 in 2023-07-13T01:49:53.299 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5180407 mon.a (mon.0) 958 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5186973 mon.a (mon.0) 959 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5190537 mon.a (mon.0) 960 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5193853 mon.a (mon.0) 961 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5197406 mon.a (mon.0) 962 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.520122 mon.a (mon.0) 963 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5204866 mon.a (mon.0) 964 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:53.300 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5207727 mon.a (mon.0) 965 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:53.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5210986 mon.a (mon.0) 966 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:53.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.521472 mon.a (mon.0) 967 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:53.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.521857 mon.a (mon.0) 968 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:53.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.522224 mon.a (mon.0) 969 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:53.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.52251 mon.a (mon.0) 970 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:53.301 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:53 smithi154 bash[27744]: audit 1689212992.5229049 mon.a (mon.0) 971 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:49:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: cluster 1689212991.5310159 mgr.a (mgr.14152) 659 : cluster 0 pgmap v547: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5077941 mon.a (mon.0) 955 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5143576 mon.e (mon.1) 12 : audit 1 from='client.? 172.21.15.154:0/1469862130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5176048 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]': finished 2023-07-13T01:49:53.302 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: cluster 1689212992.517728 mon.a (mon.0) 957 : cluster 0 osdmap e22: 14 total, 0 up, 10 in 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5180407 mon.a (mon.0) 958 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5186973 mon.a (mon.0) 959 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5190537 mon.a (mon.0) 960 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5193853 mon.a (mon.0) 961 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5197406 mon.a (mon.0) 962 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.520122 mon.a (mon.0) 963 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5204866 mon.a (mon.0) 964 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:53.303 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5207727 mon.a (mon.0) 965 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:53.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5210986 mon.a (mon.0) 966 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:53.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.521472 mon.a (mon.0) 967 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:53.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.521857 mon.a (mon.0) 968 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:53.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.522224 mon.a (mon.0) 969 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:53.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.52251 mon.a (mon.0) 970 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:53.304 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:53 smithi137 bash[27262]: audit 1689212992.5229049 mon.a (mon.0) 971 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:49:53.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: cluster 1689212991.5310159 mgr.a (mgr.14152) 659 : cluster 0 pgmap v547: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5077941 mon.a (mon.0) 955 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5143576 mon.e (mon.1) 12 : audit 1 from='client.? 172.21.15.154:0/1469862130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5176048 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]': finished 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: cluster 1689212992.517728 mon.a (mon.0) 957 : cluster 0 osdmap e22: 14 total, 0 up, 10 in 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5180407 mon.a (mon.0) 958 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5186973 mon.a (mon.0) 959 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:53.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5190537 mon.a (mon.0) 960 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5193853 mon.a (mon.0) 961 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5197406 mon.a (mon.0) 962 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.520122 mon.a (mon.0) 963 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5204866 mon.a (mon.0) 964 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5207727 mon.a (mon.0) 965 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5210986 mon.a (mon.0) 966 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.521472 mon.a (mon.0) 967 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:53.350 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.521857 mon.a (mon.0) 968 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:53.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.522224 mon.a (mon.0) 969 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:53.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.52251 mon.a (mon.0) 970 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:53.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:53 smithi103 bash[27315]: audit 1689212992.5229049 mon.a (mon.0) 971 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:49:53.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: cluster 1689212991.5310159 mgr.a (mgr.14152) 659 : cluster 0 pgmap v547: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:53.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5077941 mon.a (mon.0) 955 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5143576 mon.e (mon.1) 12 : audit 1 from='client.? 172.21.15.154:0/1469862130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5176048 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]': finished 2023-07-13T01:49:53.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: cluster 1689212992.517728 mon.a (mon.0) 957 : cluster 0 osdmap e22: 14 total, 0 up, 10 in 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5180407 mon.a (mon.0) 958 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5186973 mon.a (mon.0) 959 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5190537 mon.a (mon.0) 960 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5193853 mon.a (mon.0) 961 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5197406 mon.a (mon.0) 962 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.520122 mon.a (mon.0) 963 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5204866 mon.a (mon.0) 964 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:53.390 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5207727 mon.a (mon.0) 965 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:53.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5210986 mon.a (mon.0) 966 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:53.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.521472 mon.a (mon.0) 967 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:53.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.521857 mon.a (mon.0) 968 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:53.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.522224 mon.a (mon.0) 969 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:53.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.52251 mon.a (mon.0) 970 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:53.392 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:53 smithi084 bash[27323]: audit 1689212992.5229049 mon.a (mon.0) 971 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:49:53.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: cluster 1689212991.5310159 mgr.a (mgr.14152) 659 : cluster 0 pgmap v547: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:53.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5077941 mon.a (mon.0) 955 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5143576 mon.e (mon.1) 12 : audit 1 from='client.? 172.21.15.154:0/1469862130' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]: dispatch 2023-07-13T01:49:53.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5176048 mon.a (mon.0) 956 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b877f3ec-4c60-4eed-8a72-425de0951741"}]': finished 2023-07-13T01:49:53.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: cluster 1689212992.517728 mon.a (mon.0) 957 : cluster 0 osdmap e22: 14 total, 0 up, 10 in 2023-07-13T01:49:53.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5180407 mon.a (mon.0) 958 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:49:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5186973 mon.a (mon.0) 959 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:49:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5190537 mon.a (mon.0) 960 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:49:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5193853 mon.a (mon.0) 961 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:49:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5197406 mon.a (mon.0) 962 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:49:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.520122 mon.a (mon.0) 963 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:49:53.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5204866 mon.a (mon.0) 964 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5207727 mon.a (mon.0) 965 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5210986 mon.a (mon.0) 966 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.521472 mon.a (mon.0) 967 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.521857 mon.a (mon.0) 968 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.522224 mon.a (mon.0) 969 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.52251 mon.a (mon.0) 970 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:49:53.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:53 smithi022 bash[26979]: audit 1689212992.5229049 mon.a (mon.0) 971 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:49:54.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:54 smithi154 bash[27744]: audit 1689212993.4795494 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.154:0/338036071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:49:54.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:54 smithi137 bash[27262]: audit 1689212993.4795494 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.154:0/338036071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:49:54.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:54 smithi103 bash[27315]: audit 1689212993.4795494 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.154:0/338036071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:49:54.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:54 smithi084 bash[27323]: audit 1689212993.4795494 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.154:0/338036071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:49:54.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:54 smithi022 bash[26979]: audit 1689212993.4795494 mon.c (mon.2) 8 : audit 0 from='client.? 172.21.15.154:0/338036071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:49:54.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:49:54 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:49:55.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:55 smithi137 bash[27262]: cluster 1689212993.5315132 mgr.a (mgr.14152) 660 : cluster 0 pgmap v549: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:55.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:55 smithi103 bash[27315]: cluster 1689212993.5315132 mgr.a (mgr.14152) 660 : cluster 0 pgmap v549: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:55.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:55 smithi084 bash[27323]: cluster 1689212993.5315132 mgr.a (mgr.14152) 660 : cluster 0 pgmap v549: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:55.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:55 smithi022 bash[26979]: cluster 1689212993.5315132 mgr.a (mgr.14152) 660 : cluster 0 pgmap v549: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:55.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:55 smithi154 bash[27744]: cluster 1689212993.5315132 mgr.a (mgr.14152) 660 : cluster 0 pgmap v549: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:57.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:57 smithi137 bash[27262]: cluster 1689212995.5320199 mgr.a (mgr.14152) 661 : cluster 0 pgmap v550: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:57.298 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:56 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:49:57.298 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:56 smithi137 systemd[1]: Stopped Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:57.298 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:56 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Start request repeated too quickly. 2023-07-13T01:49:57.298 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:56 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service: Failed with result 'exit-code'. 2023-07-13T01:49:57.299 INFO:journalctl@ceph.osd.11.smithi137.stdout:Jul 13 01:49:56 smithi137 systemd[1]: Failed to start Ceph osd.11 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:49:57.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:57 smithi103 bash[27315]: cluster 1689212995.5320199 mgr.a (mgr.14152) 661 : cluster 0 pgmap v550: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:57.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:57 smithi084 bash[27323]: cluster 1689212995.5320199 mgr.a (mgr.14152) 661 : cluster 0 pgmap v550: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:57.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:57 smithi022 bash[26979]: cluster 1689212995.5320199 mgr.a (mgr.14152) 661 : cluster 0 pgmap v550: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:57.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:57 smithi154 bash[27744]: cluster 1689212995.5320199 mgr.a (mgr.14152) 661 : cluster 0 pgmap v550: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:59.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:49:59 smithi137 bash[27262]: cluster 1689212997.5325334 mgr.a (mgr.14152) 662 : cluster 0 pgmap v551: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:59.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:49:59 smithi103 bash[27315]: cluster 1689212997.5325334 mgr.a (mgr.14152) 662 : cluster 0 pgmap v551: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:59.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:49:59 smithi084 bash[27323]: cluster 1689212997.5325334 mgr.a (mgr.14152) 662 : cluster 0 pgmap v551: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:59.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:49:59 smithi022 bash[26979]: cluster 1689212997.5325334 mgr.a (mgr.14152) 662 : cluster 0 pgmap v551: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:49:59.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:49:59 smithi154 bash[27744]: cluster 1689212997.5325334 mgr.a (mgr.14152) 662 : cluster 0 pgmap v551: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:00.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:00 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 12. 2023-07-13T01:50:00.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:00 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:00.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:00 smithi137 systemd[1]: Started Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:01.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689212999.5330474 mgr.a (mgr.14152) 663 : cluster 0 pgmap v552: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:01.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.000175 mon.a (mon.0) 972 : cluster 3 Health detail: HEALTH_WARN 12 failed cephadm daemon(s) 2023-07-13T01:50:01.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.000222 mon.a (mon.0) 973 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 12 failed cephadm daemon(s) 2023-07-13T01:50:01.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.000246 mon.a (mon.0) 974 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0002637 mon.a (mon.0) 975 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0002804 mon.a (mon.0) 976 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0003011 mon.a (mon.0) 977 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0003388 mon.a (mon.0) 978 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0003595 mon.a (mon.0) 979 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0003846 mon.a (mon.0) 980 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T01:50:01.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.000408 mon.a (mon.0) 981 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T01:50:01.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0004332 mon.a (mon.0) 982 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T01:50:01.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0004559 mon.a (mon.0) 983 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T01:50:01.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.0004816 mon.a (mon.0) 984 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T01:50:01.050 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:00 smithi137 bash[27262]: cluster 1689213000.000502 mon.a (mon.0) 985 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T01:50:01.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689212999.5330474 mgr.a (mgr.14152) 663 : cluster 0 pgmap v552: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:01.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.000175 mon.a (mon.0) 972 : cluster 3 Health detail: HEALTH_WARN 12 failed cephadm daemon(s) 2023-07-13T01:50:01.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.000222 mon.a (mon.0) 973 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 12 failed cephadm daemon(s) 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.000246 mon.a (mon.0) 974 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0002637 mon.a (mon.0) 975 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0002804 mon.a (mon.0) 976 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0003011 mon.a (mon.0) 977 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0003388 mon.a (mon.0) 978 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0003595 mon.a (mon.0) 979 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T01:50:01.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0003846 mon.a (mon.0) 980 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T01:50:01.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.000408 mon.a (mon.0) 981 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T01:50:01.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0004332 mon.a (mon.0) 982 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T01:50:01.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0004559 mon.a (mon.0) 983 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T01:50:01.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.0004816 mon.a (mon.0) 984 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T01:50:01.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:00 smithi103 bash[27315]: cluster 1689213000.000502 mon.a (mon.0) 985 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T01:50:01.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689212999.5330474 mgr.a (mgr.14152) 663 : cluster 0 pgmap v552: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:01.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.000175 mon.a (mon.0) 972 : cluster 3 Health detail: HEALTH_WARN 12 failed cephadm daemon(s) 2023-07-13T01:50:01.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.000222 mon.a (mon.0) 973 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 12 failed cephadm daemon(s) 2023-07-13T01:50:01.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.000246 mon.a (mon.0) 974 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:50:01.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0002637 mon.a (mon.0) 975 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:50:01.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0002804 mon.a (mon.0) 976 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:50:01.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0003011 mon.a (mon.0) 977 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T01:50:01.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0003388 mon.a (mon.0) 978 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T01:50:01.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0003595 mon.a (mon.0) 979 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T01:50:01.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0003846 mon.a (mon.0) 980 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T01:50:01.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.000408 mon.a (mon.0) 981 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T01:50:01.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0004332 mon.a (mon.0) 982 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T01:50:01.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0004559 mon.a (mon.0) 983 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T01:50:01.142 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.0004816 mon.a (mon.0) 984 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T01:50:01.143 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:00 smithi084 bash[27323]: cluster 1689213000.000502 mon.a (mon.0) 985 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T01:50:01.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689212999.5330474 mgr.a (mgr.14152) 663 : cluster 0 pgmap v552: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:01.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.000175 mon.a (mon.0) 972 : cluster 3 Health detail: HEALTH_WARN 12 failed cephadm daemon(s) 2023-07-13T01:50:01.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.000222 mon.a (mon.0) 973 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 12 failed cephadm daemon(s) 2023-07-13T01:50:01.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.000246 mon.a (mon.0) 974 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:50:01.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0002637 mon.a (mon.0) 975 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:50:01.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0002804 mon.a (mon.0) 976 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:50:01.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0003011 mon.a (mon.0) 977 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T01:50:01.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0003388 mon.a (mon.0) 978 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T01:50:01.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0003595 mon.a (mon.0) 979 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T01:50:01.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0003846 mon.a (mon.0) 980 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T01:50:01.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.000408 mon.a (mon.0) 981 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T01:50:01.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0004332 mon.a (mon.0) 982 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T01:50:01.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0004559 mon.a (mon.0) 983 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T01:50:01.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.0004816 mon.a (mon.0) 984 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T01:50:01.158 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:00 smithi022 bash[26979]: cluster 1689213000.000502 mon.a (mon.0) 985 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T01:50:01.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689212999.5330474 mgr.a (mgr.14152) 663 : cluster 0 pgmap v552: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:01.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.000175 mon.a (mon.0) 972 : cluster 3 Health detail: HEALTH_WARN 12 failed cephadm daemon(s) 2023-07-13T01:50:01.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.000222 mon.a (mon.0) 973 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 12 failed cephadm daemon(s) 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.000246 mon.a (mon.0) 974 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0002637 mon.a (mon.0) 975 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0002804 mon.a (mon.0) 976 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0003011 mon.a (mon.0) 977 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0003388 mon.a (mon.0) 978 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0003595 mon.a (mon.0) 979 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T01:50:01.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0003846 mon.a (mon.0) 980 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T01:50:01.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.000408 mon.a (mon.0) 981 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T01:50:01.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0004332 mon.a (mon.0) 982 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T01:50:01.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0004559 mon.a (mon.0) 983 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T01:50:01.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.0004816 mon.a (mon.0) 984 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T01:50:01.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:00 smithi154 bash[27744]: cluster 1689213000.000502 mon.a (mon.0) 985 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T01:50:01.439 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:50:01 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:50:01.439 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:50:01 smithi137 systemd[1]: Stopped Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:01.439 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:50:01 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Start request repeated too quickly. 2023-07-13T01:50:01.439 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:50:01 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service: Failed with result 'exit-code'. 2023-07-13T01:50:01.439 INFO:journalctl@ceph.osd.10.smithi137.stdout:Jul 13 01:50:01 smithi137 systemd[1]: Failed to start Ceph osd.10 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:01.797 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:01 smithi137 bash[48225]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:01.798 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:01 smithi137 bash[48225]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:01.798 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:01 smithi137 bash[48225]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:01.798 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:01 smithi137 bash[48225]: --> Failed to activate any OSD(s) 2023-07-13T01:50:03.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:02 smithi137 bash[27262]: cluster 1689213001.5334487 mgr.a (mgr.14152) 664 : cluster 0 pgmap v553: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:03.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:02 smithi103 bash[27315]: cluster 1689213001.5334487 mgr.a (mgr.14152) 664 : cluster 0 pgmap v553: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:03.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:02 smithi084 bash[27323]: cluster 1689213001.5334487 mgr.a (mgr.14152) 664 : cluster 0 pgmap v553: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:03.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:02 smithi022 bash[26979]: cluster 1689213001.5334487 mgr.a (mgr.14152) 664 : cluster 0 pgmap v553: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:03.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:02 smithi154 bash[27744]: cluster 1689213001.5334487 mgr.a (mgr.14152) 664 : cluster 0 pgmap v553: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:03.547 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:03 smithi137 bash[48328]: debug 2023-07-13T01:50:03.120+0000 7f4b3e93c700 1 -- 172.21.15.137:0/1387783582 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556db8a50d00 con 0x556db8aa6c00 2023-07-13T01:50:03.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:03 smithi137 bash[48328]: debug 2023-07-13T01:50:03.120+0000 7f4b47ac1640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:50:04.297 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:03 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:50:04.770 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:04 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:50:04.771 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:04 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:04.771 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:04 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:05.000 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:04 smithi154 bash[27744]: cluster 1689213003.5338829 mgr.a (mgr.14152) 665 : cluster 0 pgmap v554: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:05.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:04 smithi137 bash[27262]: cluster 1689213003.5338829 mgr.a (mgr.14152) 665 : cluster 0 pgmap v554: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:05.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:04 smithi103 bash[27315]: cluster 1689213003.5338829 mgr.a (mgr.14152) 665 : cluster 0 pgmap v554: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:05.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:04 smithi084 bash[27323]: cluster 1689213003.5338829 mgr.a (mgr.14152) 665 : cluster 0 pgmap v554: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:05.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:04 smithi022 bash[26979]: cluster 1689213003.5338829 mgr.a (mgr.14152) 665 : cluster 0 pgmap v554: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:05.797 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:05 smithi137 bash[27262]: audit 1689213005.7126007 mon.a (mon.0) 986 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.13"}]: dispatch 2023-07-13T01:50:05.798 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:05 smithi137 bash[27262]: audit 1689213005.714271 mon.a (mon.0) 987 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:06.047 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:05 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:50:06.058 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:05 smithi154 bash[27744]: audit 1689213005.7126007 mon.a (mon.0) 986 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.13"}]: dispatch 2023-07-13T01:50:06.058 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:05 smithi154 bash[27744]: audit 1689213005.714271 mon.a (mon.0) 987 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:06.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:05 smithi103 bash[27315]: audit 1689213005.7126007 mon.a (mon.0) 986 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.13"}]: dispatch 2023-07-13T01:50:06.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:05 smithi103 bash[27315]: audit 1689213005.714271 mon.a (mon.0) 987 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:06.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:05 smithi084 bash[27323]: audit 1689213005.7126007 mon.a (mon.0) 986 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.13"}]: dispatch 2023-07-13T01:50:06.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:05 smithi084 bash[27323]: audit 1689213005.714271 mon.a (mon.0) 987 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:06.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:05 smithi022 bash[26979]: audit 1689213005.7126007 mon.a (mon.0) 986 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.13"}]: dispatch 2023-07-13T01:50:06.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:05 smithi022 bash[26979]: audit 1689213005.714271 mon.a (mon.0) 987 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:06.328 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:06 smithi154 bash[35920]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:06.329 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:06 smithi154 bash[35920]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:06.329 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:06 smithi154 bash[35920]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:06.329 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:06 smithi154 bash[35920]: --> Failed to activate any OSD(s) 2023-07-13T01:50:06.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:06 smithi154 bash[27744]: cluster 1689213005.5344 mgr.a (mgr.14152) 666 : cluster 0 pgmap v555: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:07.000 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:06 smithi154 bash[27744]: cephadm 1689213005.7157147 mgr.a (mgr.14152) 667 : cephadm 1 Deploying daemon osd.13 on smithi154 2023-07-13T01:50:07.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:06 smithi137 bash[27262]: cluster 1689213005.5344 mgr.a (mgr.14152) 666 : cluster 0 pgmap v555: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:07.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:06 smithi137 bash[27262]: cephadm 1689213005.7157147 mgr.a (mgr.14152) 667 : cephadm 1 Deploying daemon osd.13 on smithi154 2023-07-13T01:50:07.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:06 smithi103 bash[27315]: cluster 1689213005.5344 mgr.a (mgr.14152) 666 : cluster 0 pgmap v555: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:07.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:06 smithi103 bash[27315]: cephadm 1689213005.7157147 mgr.a (mgr.14152) 667 : cephadm 1 Deploying daemon osd.13 on smithi154 2023-07-13T01:50:07.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:06 smithi084 bash[27323]: cluster 1689213005.5344 mgr.a (mgr.14152) 666 : cluster 0 pgmap v555: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:07.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:06 smithi084 bash[27323]: cephadm 1689213005.7157147 mgr.a (mgr.14152) 667 : cephadm 1 Deploying daemon osd.13 on smithi154 2023-07-13T01:50:07.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:06 smithi022 bash[26979]: cluster 1689213005.5344 mgr.a (mgr.14152) 666 : cluster 0 pgmap v555: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:07.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:06 smithi022 bash[26979]: cephadm 1689213005.7157147 mgr.a (mgr.14152) 667 : cephadm 1 Deploying daemon osd.13 on smithi154 2023-07-13T01:50:09.037 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:08 smithi154 bash[27744]: cluster 1689213007.5348735 mgr.a (mgr.14152) 668 : cluster 0 pgmap v556: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:09.037 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:08 smithi154 bash[36089]: debug 2023-07-13T01:50:08.966+0000 7f2b4413e700 1 -- 172.21.15.154:0/1723852504 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556f5d06ad00 con 0x556f5d0c0800 2023-07-13T01:50:09.037 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:08 smithi154 bash[36089]: debug 2023-07-13T01:50:08.966+0000 7f2b4d2c3640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:50:09.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:08 smithi137 bash[27262]: cluster 1689213007.5348735 mgr.a (mgr.14152) 668 : cluster 0 pgmap v556: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:09.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:08 smithi103 bash[27315]: cluster 1689213007.5348735 mgr.a (mgr.14152) 668 : cluster 0 pgmap v556: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:09.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:08 smithi084 bash[27323]: cluster 1689213007.5348735 mgr.a (mgr.14152) 668 : cluster 0 pgmap v556: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:09.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:08 smithi022 bash[26979]: cluster 1689213007.5348735 mgr.a (mgr.14152) 668 : cluster 0 pgmap v556: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:10.471 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:10 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:50:11.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:10 smithi137 bash[27262]: cluster 1689213009.5354235 mgr.a (mgr.14152) 669 : cluster 0 pgmap v557: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:11.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:10 smithi103 bash[27315]: cluster 1689213009.5354235 mgr.a (mgr.14152) 669 : cluster 0 pgmap v557: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:11.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:10 smithi084 bash[27323]: cluster 1689213009.5354235 mgr.a (mgr.14152) 669 : cluster 0 pgmap v557: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:11.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:10 smithi022 bash[26979]: cluster 1689213009.5354235 mgr.a (mgr.14152) 669 : cluster 0 pgmap v557: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:11.170 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:10 smithi154 bash[27744]: cluster 1689213009.5354235 mgr.a (mgr.14152) 669 : cluster 0 pgmap v557: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:13.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: cluster 1689213011.5359063 mgr.a (mgr.14152) 670 : cluster 0 pgmap v558: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:13.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: audit 1689213012.4991121 mon.a (mon.0) 988 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.048 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: audit 1689213012.5065503 mon.a (mon.0) 989 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: audit 1689213012.5242355 mon.a (mon.0) 990 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:13.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: audit 1689213012.5293658 mon.a (mon.0) 991 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: audit 1689213012.5322282 mon.a (mon.0) 992 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.049 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:12 smithi137 bash[27262]: audit 1689213012.5338717 mon.a (mon.0) 993 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: cluster 1689213011.5359063 mgr.a (mgr.14152) 670 : cluster 0 pgmap v558: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:13.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: audit 1689213012.4991121 mon.a (mon.0) 988 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: audit 1689213012.5065503 mon.a (mon.0) 989 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: audit 1689213012.5242355 mon.a (mon.0) 990 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:13.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: audit 1689213012.5293658 mon.a (mon.0) 991 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: audit 1689213012.5322282 mon.a (mon.0) 992 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:12 smithi103 bash[27315]: audit 1689213012.5338717 mon.a (mon.0) 993 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: cluster 1689213011.5359063 mgr.a (mgr.14152) 670 : cluster 0 pgmap v558: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:13.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: audit 1689213012.4991121 mon.a (mon.0) 988 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: audit 1689213012.5065503 mon.a (mon.0) 989 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: audit 1689213012.5242355 mon.a (mon.0) 990 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:13.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: audit 1689213012.5293658 mon.a (mon.0) 991 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: audit 1689213012.5322282 mon.a (mon.0) 992 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:12 smithi084 bash[27323]: audit 1689213012.5338717 mon.a (mon.0) 993 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: cluster 1689213011.5359063 mgr.a (mgr.14152) 670 : cluster 0 pgmap v558: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:13.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: audit 1689213012.4991121 mon.a (mon.0) 988 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: audit 1689213012.5065503 mon.a (mon.0) 989 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: audit 1689213012.5242355 mon.a (mon.0) 990 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:13.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: audit 1689213012.5293658 mon.a (mon.0) 991 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: audit 1689213012.5322282 mon.a (mon.0) 992 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:12 smithi022 bash[26979]: audit 1689213012.5338717 mon.a (mon.0) 993 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: cluster 1689213011.5359063 mgr.a (mgr.14152) 670 : cluster 0 pgmap v558: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:13.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: audit 1689213012.4991121 mon.a (mon.0) 988 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: audit 1689213012.5065503 mon.a (mon.0) 989 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:13.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: audit 1689213012.5242355 mon.a (mon.0) 990 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:13.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: audit 1689213012.5293658 mon.a (mon.0) 991 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: audit 1689213012.5322282 mon.a (mon.0) 992 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:12 smithi154 bash[27744]: audit 1689213012.5338717 mon.a (mon.0) 993 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:13.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:13 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:50:14.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:13 smithi103 bash[27315]: cephadm 1689213012.5354755 mgr.a (mgr.14152) 671 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:50:14.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:13 smithi084 bash[27323]: cephadm 1689213012.5354755 mgr.a (mgr.14152) 671 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:50:14.143 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:13 smithi154 bash[27744]: cephadm 1689213012.5354755 mgr.a (mgr.14152) 671 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:50:14.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:13 smithi022 bash[26979]: cephadm 1689213012.5354755 mgr.a (mgr.14152) 671 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:50:14.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:13 smithi137 bash[27262]: cephadm 1689213012.5354755 mgr.a (mgr.14152) 671 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T01:50:15.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:14 smithi103 bash[27315]: cluster 1689213013.5364401 mgr.a (mgr.14152) 672 : cluster 0 pgmap v559: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:15.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:14 smithi084 bash[27323]: cluster 1689213013.5364401 mgr.a (mgr.14152) 672 : cluster 0 pgmap v559: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:15.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:14 smithi022 bash[26979]: cluster 1689213013.5364401 mgr.a (mgr.14152) 672 : cluster 0 pgmap v559: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:15.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:14 smithi154 bash[27744]: cluster 1689213013.5364401 mgr.a (mgr.14152) 672 : cluster 0 pgmap v559: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:15.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:14 smithi137 bash[27262]: cluster 1689213013.5364401 mgr.a (mgr.14152) 672 : cluster 0 pgmap v559: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:16.547 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:16 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Scheduled restart job, restart counter is at 13. 2023-07-13T01:50:16.547 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:16 smithi137 systemd[1]: Stopped Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:16.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:16 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Start request repeated too quickly. 2023-07-13T01:50:16.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:16 smithi137 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service: Failed with result 'exit-code'. 2023-07-13T01:50:16.548 INFO:journalctl@ceph.osd.9.smithi137.stdout:Jul 13 01:50:16 smithi137 systemd[1]: Failed to start Ceph osd.9 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:16.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:16 smithi154 bash[27744]: cluster 1689213015.53699 mgr.a (mgr.14152) 673 : cluster 0 pgmap v560: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:17.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:16 smithi103 bash[27315]: cluster 1689213015.53699 mgr.a (mgr.14152) 673 : cluster 0 pgmap v560: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:17.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:16 smithi084 bash[27323]: cluster 1689213015.53699 mgr.a (mgr.14152) 673 : cluster 0 pgmap v560: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:17.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:16 smithi022 bash[26979]: cluster 1689213015.53699 mgr.a (mgr.14152) 673 : cluster 0 pgmap v560: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:17.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:16 smithi137 bash[27262]: cluster 1689213015.53699 mgr.a (mgr.14152) 673 : cluster 0 pgmap v560: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: cluster 1689213017.5375223 mgr.a (mgr.14152) 674 : cluster 0 pgmap v561: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: audit 1689213017.8756554 mon.a (mon.0) 994 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: audit 1689213017.8847928 mon.a (mon.0) 995 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: audit 1689213017.8861682 mon.a (mon.0) 996 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:19.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: audit 1689213017.887559 mon.a (mon.0) 997 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:19.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: cluster 1689213017.8899796 mgr.a (mgr.14152) 675 : cluster 0 pgmap v562: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: cluster 1689213017.8902318 mgr.a (mgr.14152) 676 : cluster 0 pgmap v563: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:18 smithi154 bash[27744]: audit 1689213017.8969417 mon.a (mon.0) 998 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: cluster 1689213017.5375223 mgr.a (mgr.14152) 674 : cluster 0 pgmap v561: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: audit 1689213017.8756554 mon.a (mon.0) 994 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: audit 1689213017.8847928 mon.a (mon.0) 995 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: audit 1689213017.8861682 mon.a (mon.0) 996 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:19.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: audit 1689213017.887559 mon.a (mon.0) 997 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:19.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: cluster 1689213017.8899796 mgr.a (mgr.14152) 675 : cluster 0 pgmap v562: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: cluster 1689213017.8902318 mgr.a (mgr.14152) 676 : cluster 0 pgmap v563: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:18 smithi084 bash[27323]: audit 1689213017.8969417 mon.a (mon.0) 998 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: cluster 1689213017.5375223 mgr.a (mgr.14152) 674 : cluster 0 pgmap v561: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: audit 1689213017.8756554 mon.a (mon.0) 994 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: audit 1689213017.8847928 mon.a (mon.0) 995 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: audit 1689213017.8861682 mon.a (mon.0) 996 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:19.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: audit 1689213017.887559 mon.a (mon.0) 997 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:19.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: cluster 1689213017.8899796 mgr.a (mgr.14152) 675 : cluster 0 pgmap v562: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: cluster 1689213017.8902318 mgr.a (mgr.14152) 676 : cluster 0 pgmap v563: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:18 smithi022 bash[26979]: audit 1689213017.8969417 mon.a (mon.0) 998 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: cluster 1689213017.5375223 mgr.a (mgr.14152) 674 : cluster 0 pgmap v561: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: audit 1689213017.8756554 mon.a (mon.0) 994 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: audit 1689213017.8847928 mon.a (mon.0) 995 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: audit 1689213017.8861682 mon.a (mon.0) 996 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:19.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: audit 1689213017.887559 mon.a (mon.0) 997 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:19.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: cluster 1689213017.8899796 mgr.a (mgr.14152) 675 : cluster 0 pgmap v562: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: cluster 1689213017.8902318 mgr.a (mgr.14152) 676 : cluster 0 pgmap v563: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:18 smithi137 bash[27262]: audit 1689213017.8969417 mon.a (mon.0) 998 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: cluster 1689213017.5375223 mgr.a (mgr.14152) 674 : cluster 0 pgmap v561: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: audit 1689213017.8756554 mon.a (mon.0) 994 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: audit 1689213017.8847928 mon.a (mon.0) 995 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: audit 1689213017.8861682 mon.a (mon.0) 996 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:19.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: audit 1689213017.887559 mon.a (mon.0) 997 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:19.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: cluster 1689213017.8899796 mgr.a (mgr.14152) 675 : cluster 0 pgmap v562: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: cluster 1689213017.8902318 mgr.a (mgr.14152) 676 : cluster 0 pgmap v563: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:19.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:18 smithi103 bash[27315]: audit 1689213017.8969417 mon.a (mon.0) 998 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:19.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:19 smithi154 bash[27744]: cluster 1689213018.880629 mon.a (mon.0) 999 : cluster 3 Health check update: 13 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:50:20.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:19 smithi084 bash[27323]: cluster 1689213018.880629 mon.a (mon.0) 999 : cluster 3 Health check update: 13 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:50:20.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:19 smithi022 bash[26979]: cluster 1689213018.880629 mon.a (mon.0) 999 : cluster 3 Health check update: 13 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:50:20.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:19 smithi137 bash[27262]: cluster 1689213018.880629 mon.a (mon.0) 999 : cluster 3 Health check update: 13 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:50:20.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:19 smithi103 bash[27315]: cluster 1689213018.880629 mon.a (mon.0) 999 : cluster 3 Health check update: 13 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:50:20.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:20 smithi154 bash[27744]: cluster 1689213019.8907025 mgr.a (mgr.14152) 677 : cluster 0 pgmap v564: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:21.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:20 smithi084 bash[27323]: cluster 1689213019.8907025 mgr.a (mgr.14152) 677 : cluster 0 pgmap v564: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:21.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:20 smithi022 bash[26979]: cluster 1689213019.8907025 mgr.a (mgr.14152) 677 : cluster 0 pgmap v564: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:21.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:20 smithi137 bash[27262]: cluster 1689213019.8907025 mgr.a (mgr.14152) 677 : cluster 0 pgmap v564: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:21.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:20 smithi103 bash[27315]: cluster 1689213019.8907025 mgr.a (mgr.14152) 677 : cluster 0 pgmap v564: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:21.981 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 13 on host 'smithi154' 2023-07-13T01:50:22.682 DEBUG:teuthology.orchestra.run.smithi154:osd.13> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service 2023-07-13T01:50:22.684 INFO:tasks.cephadm:Deploying osd.14 on smithi154 with /dev/vg_nvme/lv_2... 2023-07-13T01:50:22.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-13T01:50:22.971 INFO:journalctl@ceph.osd.13.smithi154.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:50:23.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:22 smithi154 bash[27744]: cluster 1689213021.8912296 mgr.a (mgr.14152) 678 : cluster 0 pgmap v565: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:23.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:22 smithi154 bash[27744]: audit 1689213021.9833152 mon.a (mon.0) 1000 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:22 smithi154 bash[27744]: audit 1689213021.9908412 mon.a (mon.0) 1001 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:22 smithi154 bash[27744]: audit 1689213021.991239 mon.a (mon.0) 1002 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:23.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:22 smithi137 bash[27262]: cluster 1689213021.8912296 mgr.a (mgr.14152) 678 : cluster 0 pgmap v565: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:23.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:22 smithi137 bash[27262]: audit 1689213021.9833152 mon.a (mon.0) 1000 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:22 smithi137 bash[27262]: audit 1689213021.9908412 mon.a (mon.0) 1001 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:22 smithi137 bash[27262]: audit 1689213021.991239 mon.a (mon.0) 1002 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:23.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:22 smithi103 bash[27315]: cluster 1689213021.8912296 mgr.a (mgr.14152) 678 : cluster 0 pgmap v565: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:23.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:22 smithi103 bash[27315]: audit 1689213021.9833152 mon.a (mon.0) 1000 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:22 smithi103 bash[27315]: audit 1689213021.9908412 mon.a (mon.0) 1001 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:22 smithi103 bash[27315]: audit 1689213021.991239 mon.a (mon.0) 1002 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:23.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:22 smithi084 bash[27323]: cluster 1689213021.8912296 mgr.a (mgr.14152) 678 : cluster 0 pgmap v565: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:23.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:22 smithi084 bash[27323]: audit 1689213021.9833152 mon.a (mon.0) 1000 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:22 smithi084 bash[27323]: audit 1689213021.9908412 mon.a (mon.0) 1001 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:22 smithi084 bash[27323]: audit 1689213021.991239 mon.a (mon.0) 1002 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:23.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:22 smithi022 bash[26979]: cluster 1689213021.8912296 mgr.a (mgr.14152) 678 : cluster 0 pgmap v565: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:23.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:22 smithi022 bash[26979]: audit 1689213021.9833152 mon.a (mon.0) 1000 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:22 smithi022 bash[26979]: audit 1689213021.9908412 mon.a (mon.0) 1001 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:23.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:22 smithi022 bash[26979]: audit 1689213021.991239 mon.a (mon.0) 1002 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:50:23.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:23 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:50:24.000 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:23 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:24.000 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:23 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:25.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:24 smithi154 bash[27744]: cluster 1689213023.891685 mgr.a (mgr.14152) 679 : cluster 0 pgmap v566: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:25.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:24 smithi154 bash[37447]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:25.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:24 smithi154 bash[37447]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:25.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:24 smithi154 bash[37447]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:25.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:24 smithi154 bash[37447]: --> Failed to activate any OSD(s) 2023-07-13T01:50:25.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:24 smithi137 bash[27262]: cluster 1689213023.891685 mgr.a (mgr.14152) 679 : cluster 0 pgmap v566: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:25.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:24 smithi103 bash[27315]: cluster 1689213023.891685 mgr.a (mgr.14152) 679 : cluster 0 pgmap v566: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:25.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:24 smithi084 bash[27323]: cluster 1689213023.891685 mgr.a (mgr.14152) 679 : cluster 0 pgmap v566: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:25.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:24 smithi022 bash[26979]: cluster 1689213023.891685 mgr.a (mgr.14152) 679 : cluster 0 pgmap v566: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:26.694 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:26 smithi154 bash[37550]: debug 2023-07-13T01:50:26.514+0000 7f22d0d32700 1 -- 172.21.15.154:0/1500511355 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d2fccad00 con 0x562d2fd20c00 2023-07-13T01:50:26.694 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:26 smithi154 bash[37550]: debug 2023-07-13T01:50:26.518+0000 7f22d9eb7640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:50:27.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:26 smithi154 bash[27744]: cluster 1689213025.892194 mgr.a (mgr.14152) 680 : cluster 0 pgmap v567: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:27.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:27 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:50:27.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:26 smithi137 bash[27262]: cluster 1689213025.892194 mgr.a (mgr.14152) 680 : cluster 0 pgmap v567: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:27.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:26 smithi103 bash[27315]: cluster 1689213025.892194 mgr.a (mgr.14152) 680 : cluster 0 pgmap v567: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:27.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:26 smithi084 bash[27323]: cluster 1689213025.892194 mgr.a (mgr.14152) 680 : cluster 0 pgmap v567: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:27.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:26 smithi022 bash[26979]: cluster 1689213025.892194 mgr.a (mgr.14152) 680 : cluster 0 pgmap v567: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:28.442 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:50:29.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:29 smithi154 bash[27744]: cluster 1689213027.8927214 mgr.a (mgr.14152) 681 : cluster 0 pgmap v568: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:29.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:28 smithi137 bash[27262]: cluster 1689213027.8927214 mgr.a (mgr.14152) 681 : cluster 0 pgmap v568: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:29.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:28 smithi103 bash[27315]: cluster 1689213027.8927214 mgr.a (mgr.14152) 681 : cluster 0 pgmap v568: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:29.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:28 smithi084 bash[27323]: cluster 1689213027.8927214 mgr.a (mgr.14152) 681 : cluster 0 pgmap v568: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:29.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:28 smithi022 bash[26979]: cluster 1689213027.8927214 mgr.a (mgr.14152) 681 : cluster 0 pgmap v568: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:30.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:29 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:50:30.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:29 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:30.250 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:29 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:30.250 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:29 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:50:30.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:30 smithi154 bash[27744]: cluster 1689213029.8932474 mgr.a (mgr.14152) 682 : cluster 0 pgmap v569: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:31.047 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:30 smithi137 bash[27262]: cluster 1689213029.8932474 mgr.a (mgr.14152) 682 : cluster 0 pgmap v569: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:31.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:30 smithi103 bash[27315]: cluster 1689213029.8932474 mgr.a (mgr.14152) 682 : cluster 0 pgmap v569: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:31.141 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:30 smithi084 bash[27323]: cluster 1689213029.8932474 mgr.a (mgr.14152) 682 : cluster 0 pgmap v569: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:31.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:30 smithi022 bash[26979]: cluster 1689213029.8932474 mgr.a (mgr.14152) 682 : cluster 0 pgmap v569: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:31.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:31 smithi154 bash[37869]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:31.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:31 smithi154 bash[37869]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:32.000 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:31 smithi154 bash[37869]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:32.000 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:31 smithi154 bash[37869]: --> Failed to activate any OSD(s) 2023-07-13T01:50:33.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:32 smithi154 bash[27744]: cluster 1689213031.8937201 mgr.a (mgr.14152) 683 : cluster 0 pgmap v570: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:33.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:32 smithi137 bash[27262]: cluster 1689213031.8937201 mgr.a (mgr.14152) 683 : cluster 0 pgmap v570: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:33.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:32 smithi103 bash[27315]: cluster 1689213031.8937201 mgr.a (mgr.14152) 683 : cluster 0 pgmap v570: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:33.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:32 smithi084 bash[27323]: cluster 1689213031.8937201 mgr.a (mgr.14152) 683 : cluster 0 pgmap v570: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:33.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:32 smithi022 bash[26979]: cluster 1689213031.8937201 mgr.a (mgr.14152) 683 : cluster 0 pgmap v570: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:34.749 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:34 smithi154 bash[38151]: debug 2023-07-13T01:50:34.702+0000 7ff7c6b24700 1 -- 172.21.15.154:0/967449278 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5645c7398d00 con 0x5645c73ef000 2023-07-13T01:50:34.749 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:34 smithi154 bash[38151]: debug 2023-07-13T01:50:34.702+0000 7ff7cfca9640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:50:35.248 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-13T01:50:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-13T01:50:35.249 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2023-07-13T01:50:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2023-07-13T01:50:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0166016 s, 632 MB/s 2023-07-13T01:50:35.249 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 2023-07-13T01:50:35.249 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2023-07-13T01:50:35.258 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:34 smithi154 bash[27744]: cluster 1689213033.8941844 mgr.a (mgr.14152) 684 : cluster 0 pgmap v571: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:35.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:34 smithi137 bash[27262]: cluster 1689213033.8941844 mgr.a (mgr.14152) 684 : cluster 0 pgmap v571: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:35.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:34 smithi103 bash[27315]: cluster 1689213033.8941844 mgr.a (mgr.14152) 684 : cluster 0 pgmap v571: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:35.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:34 smithi084 bash[27323]: cluster 1689213033.8941844 mgr.a (mgr.14152) 684 : cluster 0 pgmap v571: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:35.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:34 smithi022 bash[26979]: cluster 1689213033.8941844 mgr.a (mgr.14152) 684 : cluster 0 pgmap v571: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:35.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:35 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:50:36.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2023-07-13T01:50:37.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:36 smithi154 bash[27744]: cluster 1689213035.8946862 mgr.a (mgr.14152) 685 : cluster 0 pgmap v572: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:37.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:36 smithi137 bash[27262]: cluster 1689213035.8946862 mgr.a (mgr.14152) 685 : cluster 0 pgmap v572: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:37.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:36 smithi103 bash[27315]: cluster 1689213035.8946862 mgr.a (mgr.14152) 685 : cluster 0 pgmap v572: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:37.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:36 smithi084 bash[27323]: cluster 1689213035.8946862 mgr.a (mgr.14152) 685 : cluster 0 pgmap v572: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:37.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:36 smithi022 bash[26979]: cluster 1689213035.8946862 mgr.a (mgr.14152) 685 : cluster 0 pgmap v572: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: cephadm 1689213037.0723858 mgr.a (mgr.14152) 686 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:50:38.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.08308 mon.a (mon.0) 1003 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.0905714 mon.a (mon.0) 1004 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.0922348 mon.a (mon.0) 1005 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.0937061 mon.a (mon.0) 1006 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: cephadm 1689213037.0947883 mgr.a (mgr.14152) 687 : cephadm 1 Adjusting osd_memory_target on smithi154 to 8632M 2023-07-13T01:50:38.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.101791 mon.a (mon.0) 1007 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.1036763 mon.a (mon.0) 1008 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:38.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.105118 mon.a (mon.0) 1009 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:38.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: cluster 1689213037.1078558 mgr.a (mgr.14152) 688 : cluster 0 pgmap v573: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: cluster 1689213037.1080506 mgr.a (mgr.14152) 689 : cluster 0 pgmap v574: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:38 smithi154 bash[27744]: audit 1689213037.1145158 mon.a (mon.0) 1010 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: cephadm 1689213037.0723858 mgr.a (mgr.14152) 686 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.08308 mon.a (mon.0) 1003 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.0905714 mon.a (mon.0) 1004 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.0922348 mon.a (mon.0) 1005 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.0937061 mon.a (mon.0) 1006 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: cephadm 1689213037.0947883 mgr.a (mgr.14152) 687 : cephadm 1 Adjusting osd_memory_target on smithi154 to 8632M 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.101791 mon.a (mon.0) 1007 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.1036763 mon.a (mon.0) 1008 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:38.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.105118 mon.a (mon.0) 1009 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:38.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: cluster 1689213037.1078558 mgr.a (mgr.14152) 688 : cluster 0 pgmap v573: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: cluster 1689213037.1080506 mgr.a (mgr.14152) 689 : cluster 0 pgmap v574: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.349 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:38 smithi103 bash[27315]: audit 1689213037.1145158 mon.a (mon.0) 1010 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: cephadm 1689213037.0723858 mgr.a (mgr.14152) 686 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:50:38.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.08308 mon.a (mon.0) 1003 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.0905714 mon.a (mon.0) 1004 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.0922348 mon.a (mon.0) 1005 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.0937061 mon.a (mon.0) 1006 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: cephadm 1689213037.0947883 mgr.a (mgr.14152) 687 : cephadm 1 Adjusting osd_memory_target on smithi154 to 8632M 2023-07-13T01:50:38.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.101791 mon.a (mon.0) 1007 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.1036763 mon.a (mon.0) 1008 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:38.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.105118 mon.a (mon.0) 1009 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:38.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: cluster 1689213037.1078558 mgr.a (mgr.14152) 688 : cluster 0 pgmap v573: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: cluster 1689213037.1080506 mgr.a (mgr.14152) 689 : cluster 0 pgmap v574: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.389 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:38 smithi084 bash[27323]: audit 1689213037.1145158 mon.a (mon.0) 1010 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: cephadm 1689213037.0723858 mgr.a (mgr.14152) 686 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:50:38.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.08308 mon.a (mon.0) 1003 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.0905714 mon.a (mon.0) 1004 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.0922348 mon.a (mon.0) 1005 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.0937061 mon.a (mon.0) 1006 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: cephadm 1689213037.0947883 mgr.a (mgr.14152) 687 : cephadm 1 Adjusting osd_memory_target on smithi154 to 8632M 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.101791 mon.a (mon.0) 1007 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.1036763 mon.a (mon.0) 1008 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.105118 mon.a (mon.0) 1009 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: cluster 1689213037.1078558 mgr.a (mgr.14152) 688 : cluster 0 pgmap v573: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: cluster 1689213037.1080506 mgr.a (mgr.14152) 689 : cluster 0 pgmap v574: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:38 smithi022 bash[26979]: audit 1689213037.1145158 mon.a (mon.0) 1010 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: cephadm 1689213037.0723858 mgr.a (mgr.14152) 686 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:50:38.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.08308 mon.a (mon.0) 1003 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.0905714 mon.a (mon.0) 1004 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.0922348 mon.a (mon.0) 1005 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.0937061 mon.a (mon.0) 1006 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: cephadm 1689213037.0947883 mgr.a (mgr.14152) 687 : cephadm 1 Adjusting osd_memory_target on smithi154 to 8632M 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.101791 mon.a (mon.0) 1007 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.1036763 mon.a (mon.0) 1008 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.105118 mon.a (mon.0) 1009 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:50:38.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: cluster 1689213037.1078558 mgr.a (mgr.14152) 688 : cluster 0 pgmap v573: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: cluster 1689213037.1080506 mgr.a (mgr.14152) 689 : cluster 0 pgmap v574: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:38.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:38 smithi137 bash[27262]: audit 1689213037.1145158 mon.a (mon.0) 1010 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:50:38.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:38 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:50:40.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:40 smithi022 bash[26979]: cluster 1689213039.1084905 mgr.a (mgr.14152) 690 : cluster 0 pgmap v575: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:40.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:40 smithi154 bash[27744]: cluster 1689213039.1084905 mgr.a (mgr.14152) 690 : cluster 0 pgmap v575: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:40.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:40 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:50:40.500 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:40 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:40.500 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:40 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:40.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:40 smithi137 bash[27262]: cluster 1689213039.1084905 mgr.a (mgr.14152) 690 : cluster 0 pgmap v575: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:40.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:40 smithi103 bash[27315]: cluster 1689213039.1084905 mgr.a (mgr.14152) 690 : cluster 0 pgmap v575: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:40.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:40 smithi084 bash[27323]: cluster 1689213039.1084905 mgr.a (mgr.14152) 690 : cluster 0 pgmap v575: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:41.336 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.e/config 2023-07-13T01:50:41.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:41 smithi154 bash[39339]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:41.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:41 smithi154 bash[39339]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:41.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:41 smithi154 bash[39339]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:41.750 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:41 smithi154 bash[39339]: --> Failed to activate any OSD(s) 2023-07-13T01:50:42.467 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:42 smithi154 bash[27744]: cluster 1689213041.1089802 mgr.a (mgr.14152) 691 : cluster 0 pgmap v576: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:42.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:42 smithi137 bash[27262]: cluster 1689213041.1089802 mgr.a (mgr.14152) 691 : cluster 0 pgmap v576: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:42.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:42 smithi103 bash[27315]: cluster 1689213041.1089802 mgr.a (mgr.14152) 691 : cluster 0 pgmap v576: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:42.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:42 smithi084 bash[27323]: cluster 1689213041.1089802 mgr.a (mgr.14152) 691 : cluster 0 pgmap v576: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:42.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:42 smithi022 bash[26979]: cluster 1689213041.1089802 mgr.a (mgr.14152) 691 : cluster 0 pgmap v576: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:44.231 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:44 smithi154 bash[39452]: debug 2023-07-13T01:50:44.125+0000 7fd30bec8700 1 -- 172.21.15.154:0/671357957 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e8464a0d00 con 0x55e8464f6800 2023-07-13T01:50:44.436 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:44 smithi154 bash[27744]: cluster 1689213043.109591 mgr.a (mgr.14152) 692 : cluster 0 pgmap v577: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:44.437 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:44 smithi154 bash[39452]: debug 2023-07-13T01:50:44.125+0000 7fd31504d640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:50:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:44 smithi137 bash[27262]: cluster 1689213043.109591 mgr.a (mgr.14152) 692 : cluster 0 pgmap v577: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:44 smithi103 bash[27315]: cluster 1689213043.109591 mgr.a (mgr.14152) 692 : cluster 0 pgmap v577: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:44 smithi084 bash[27323]: cluster 1689213043.109591 mgr.a (mgr.14152) 692 : cluster 0 pgmap v577: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:44 smithi022 bash[26979]: cluster 1689213043.109591 mgr.a (mgr.14152) 692 : cluster 0 pgmap v577: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:45.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:45 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:50:46.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:45 smithi103 bash[27315]: cluster 1689213045.1102362 mgr.a (mgr.14152) 693 : cluster 0 pgmap v578: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:46.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:45 smithi084 bash[27323]: cluster 1689213045.1102362 mgr.a (mgr.14152) 693 : cluster 0 pgmap v578: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:46.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:45 smithi022 bash[26979]: cluster 1689213045.1102362 mgr.a (mgr.14152) 693 : cluster 0 pgmap v578: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:46.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:45 smithi154 bash[27744]: cluster 1689213045.1102362 mgr.a (mgr.14152) 693 : cluster 0 pgmap v578: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:46.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:45 smithi137 bash[27262]: cluster 1689213045.1102362 mgr.a (mgr.14152) 693 : cluster 0 pgmap v578: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:47.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:46 smithi103 bash[27315]: audit 1689213045.8698072 mgr.a (mgr.14152) 694 : audit 0 from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:50:47.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:46 smithi103 bash[27315]: audit 1689213045.8768709 mon.a (mon.0) 1011 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:50:47.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:46 smithi103 bash[27315]: audit 1689213045.8835928 mon.a (mon.0) 1012 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:50:47.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:46 smithi103 bash[27315]: audit 1689213045.8846872 mon.a (mon.0) 1013 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:47.114 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:46 smithi154 bash[27744]: audit 1689213045.8698072 mgr.a (mgr.14152) 694 : audit 0 from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:50:47.115 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:46 smithi154 bash[27744]: audit 1689213045.8768709 mon.a (mon.0) 1011 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:50:47.115 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:46 smithi154 bash[27744]: audit 1689213045.8835928 mon.a (mon.0) 1012 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:50:47.115 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:46 smithi154 bash[27744]: audit 1689213045.8846872 mon.a (mon.0) 1013 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:47.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:46 smithi084 bash[27323]: audit 1689213045.8698072 mgr.a (mgr.14152) 694 : audit 0 from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:50:47.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:46 smithi084 bash[27323]: audit 1689213045.8768709 mon.a (mon.0) 1011 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:50:47.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:46 smithi084 bash[27323]: audit 1689213045.8835928 mon.a (mon.0) 1012 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:50:47.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:46 smithi084 bash[27323]: audit 1689213045.8846872 mon.a (mon.0) 1013 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:47.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:46 smithi022 bash[26979]: audit 1689213045.8698072 mgr.a (mgr.14152) 694 : audit 0 from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:50:47.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:46 smithi022 bash[26979]: audit 1689213045.8768709 mon.a (mon.0) 1011 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:50:47.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:46 smithi022 bash[26979]: audit 1689213045.8835928 mon.a (mon.0) 1012 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:50:47.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:46 smithi022 bash[26979]: audit 1689213045.8846872 mon.a (mon.0) 1013 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:47.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:46 smithi137 bash[27262]: audit 1689213045.8698072 mgr.a (mgr.14152) 694 : audit 0 from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-13T01:50:47.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:46 smithi137 bash[27262]: audit 1689213045.8768709 mon.a (mon.0) 1011 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-13T01:50:47.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:46 smithi137 bash[27262]: audit 1689213045.8835928 mon.a (mon.0) 1012 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-13T01:50:47.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:46 smithi137 bash[27262]: audit 1689213045.8846872 mon.a (mon.0) 1013 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:50:47.811 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:47 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:50:48.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:47 smithi103 bash[27315]: cluster 1689213047.1107855 mgr.a (mgr.14152) 695 : cluster 0 pgmap v579: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:48.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:47 smithi084 bash[27323]: cluster 1689213047.1107855 mgr.a (mgr.14152) 695 : cluster 0 pgmap v579: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:48.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:47 smithi022 bash[26979]: cluster 1689213047.1107855 mgr.a (mgr.14152) 695 : cluster 0 pgmap v579: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:48.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:47 smithi154 bash[27744]: cluster 1689213047.1107855 mgr.a (mgr.14152) 695 : cluster 0 pgmap v579: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:48.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:47 smithi137 bash[27262]: cluster 1689213047.1107855 mgr.a (mgr.14152) 695 : cluster 0 pgmap v579: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:49.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:48 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:50:49.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:48 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:49.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:48 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:50.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:50 smithi154 bash[39880]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:50.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:50 smithi154 bash[39880]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:50.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:50 smithi154 bash[39880]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:50.500 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:50 smithi154 bash[39880]: --> Failed to activate any OSD(s) 2023-07-13T01:50:50.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:50 smithi154 bash[27744]: cluster 1689213049.1113179 mgr.a (mgr.14152) 696 : cluster 0 pgmap v580: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:50.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:50 smithi137 bash[27262]: cluster 1689213049.1113179 mgr.a (mgr.14152) 696 : cluster 0 pgmap v580: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:50.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:50 smithi103 bash[27315]: cluster 1689213049.1113179 mgr.a (mgr.14152) 696 : cluster 0 pgmap v580: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:50.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:50 smithi084 bash[27323]: cluster 1689213049.1113179 mgr.a (mgr.14152) 696 : cluster 0 pgmap v580: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:50.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:50 smithi022 bash[26979]: cluster 1689213049.1113179 mgr.a (mgr.14152) 696 : cluster 0 pgmap v580: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:52.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:52 smithi154 bash[27744]: cluster 1689213051.1118648 mgr.a (mgr.14152) 697 : cluster 0 pgmap v581: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:52.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:52 smithi154 bash[40002]: debug 2023-07-13T01:50:52.121+0000 7fed96943700 1 -- 172.21.15.154:0/1775608984 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55903622cd00 con 0x559036283000 2023-07-13T01:50:52.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:52 smithi154 bash[40002]: debug 2023-07-13T01:50:52.121+0000 7fed9fac8640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:50:52.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:52 smithi137 bash[27262]: cluster 1689213051.1118648 mgr.a (mgr.14152) 697 : cluster 0 pgmap v581: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:52.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:52 smithi103 bash[27315]: cluster 1689213051.1118648 mgr.a (mgr.14152) 697 : cluster 0 pgmap v581: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:52.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:52 smithi084 bash[27323]: cluster 1689213051.1118648 mgr.a (mgr.14152) 697 : cluster 0 pgmap v581: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:52.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:52 smithi022 bash[26979]: cluster 1689213051.1118648 mgr.a (mgr.14152) 697 : cluster 0 pgmap v581: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:53.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:53 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:50:54.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:54 smithi154 bash[27744]: cluster 1689213053.1123765 mgr.a (mgr.14152) 698 : cluster 0 pgmap v582: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:54.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:54 smithi137 bash[27262]: cluster 1689213053.1123765 mgr.a (mgr.14152) 698 : cluster 0 pgmap v582: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:54.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:54 smithi103 bash[27315]: cluster 1689213053.1123765 mgr.a (mgr.14152) 698 : cluster 0 pgmap v582: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:54.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:54 smithi084 bash[27323]: cluster 1689213053.1123765 mgr.a (mgr.14152) 698 : cluster 0 pgmap v582: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:54.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:54 smithi022 bash[26979]: cluster 1689213053.1123765 mgr.a (mgr.14152) 698 : cluster 0 pgmap v582: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:55.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:55 smithi154 bash[27744]: cluster 1689213055.112893 mgr.a (mgr.14152) 699 : cluster 0 pgmap v583: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:56.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:55 smithi103 bash[27315]: cluster 1689213055.112893 mgr.a (mgr.14152) 699 : cluster 0 pgmap v583: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:56.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:55 smithi084 bash[27323]: cluster 1689213055.112893 mgr.a (mgr.14152) 699 : cluster 0 pgmap v583: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:56.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:55 smithi022 bash[26979]: cluster 1689213055.112893 mgr.a (mgr.14152) 699 : cluster 0 pgmap v583: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:56.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:55 smithi137 bash[27262]: cluster 1689213055.112893 mgr.a (mgr.14152) 699 : cluster 0 pgmap v583: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:56.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:50:56 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:50:57.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9377358 mon.a (mon.0) 1014 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9444509 mon.e (mon.1) 13 : audit 1 from='client.? 172.21.15.154:0/3204038336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9476418 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]': finished 2023-07-13T01:50:57.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: cluster 1689213055.9477296 mon.a (mon.0) 1016 : cluster 0 osdmap e23: 15 total, 0 up, 11 in 2023-07-13T01:50:57.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.947986 mon.a (mon.0) 1017 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:50:57.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9486926 mon.a (mon.0) 1018 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:50:57.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9489264 mon.a (mon.0) 1019 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:50:57.098 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9491777 mon.a (mon.0) 1020 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:50:57.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9494138 mon.a (mon.0) 1021 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:50:57.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9496505 mon.a (mon.0) 1022 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:50:57.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.949921 mon.a (mon.0) 1023 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:50:57.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9501505 mon.a (mon.0) 1024 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:50:57.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9503846 mon.a (mon.0) 1025 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:50:57.099 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.950613 mon.a (mon.0) 1026 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:50:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9508612 mon.a (mon.0) 1027 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:50:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.951139 mon.a (mon.0) 1028 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:50:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9513726 mon.a (mon.0) 1029 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:50:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9516006 mon.a (mon.0) 1030 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:50:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213055.9518666 mon.a (mon.0) 1031 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 14}]: dispatch 2023-07-13T01:50:57.100 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:56 smithi103 bash[27315]: audit 1689213056.694386 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.154:0/1824214285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:50:57.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9377358 mon.a (mon.0) 1014 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9444509 mon.e (mon.1) 13 : audit 1 from='client.? 172.21.15.154:0/3204038336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9476418 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]': finished 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: cluster 1689213055.9477296 mon.a (mon.0) 1016 : cluster 0 osdmap e23: 15 total, 0 up, 11 in 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.947986 mon.a (mon.0) 1017 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9486926 mon.a (mon.0) 1018 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9489264 mon.a (mon.0) 1019 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:50:57.138 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9491777 mon.a (mon.0) 1020 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9494138 mon.a (mon.0) 1021 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9496505 mon.a (mon.0) 1022 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.949921 mon.a (mon.0) 1023 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9501505 mon.a (mon.0) 1024 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9503846 mon.a (mon.0) 1025 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.950613 mon.a (mon.0) 1026 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9508612 mon.a (mon.0) 1027 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:50:57.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.951139 mon.a (mon.0) 1028 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:50:57.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9513726 mon.a (mon.0) 1029 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:50:57.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9516006 mon.a (mon.0) 1030 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:50:57.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213055.9518666 mon.a (mon.0) 1031 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 14}]: dispatch 2023-07-13T01:50:57.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:56 smithi084 bash[27323]: audit 1689213056.694386 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.154:0/1824214285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:50:57.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9377358 mon.a (mon.0) 1014 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9444509 mon.e (mon.1) 13 : audit 1 from='client.? 172.21.15.154:0/3204038336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9476418 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]': finished 2023-07-13T01:50:57.154 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: cluster 1689213055.9477296 mon.a (mon.0) 1016 : cluster 0 osdmap e23: 15 total, 0 up, 11 in 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.947986 mon.a (mon.0) 1017 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9486926 mon.a (mon.0) 1018 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9489264 mon.a (mon.0) 1019 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9491777 mon.a (mon.0) 1020 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9494138 mon.a (mon.0) 1021 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9496505 mon.a (mon.0) 1022 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.949921 mon.a (mon.0) 1023 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:50:57.155 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9501505 mon.a (mon.0) 1024 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9503846 mon.a (mon.0) 1025 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.950613 mon.a (mon.0) 1026 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9508612 mon.a (mon.0) 1027 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.951139 mon.a (mon.0) 1028 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9513726 mon.a (mon.0) 1029 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9516006 mon.a (mon.0) 1030 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:50:57.156 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213055.9518666 mon.a (mon.0) 1031 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 14}]: dispatch 2023-07-13T01:50:57.157 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:56 smithi022 bash[26979]: audit 1689213056.694386 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.154:0/1824214285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:50:57.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9377358 mon.a (mon.0) 1014 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9444509 mon.e (mon.1) 13 : audit 1 from='client.? 172.21.15.154:0/3204038336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9476418 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]': finished 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: cluster 1689213055.9477296 mon.a (mon.0) 1016 : cluster 0 osdmap e23: 15 total, 0 up, 11 in 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.947986 mon.a (mon.0) 1017 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9486926 mon.a (mon.0) 1018 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9489264 mon.a (mon.0) 1019 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:50:57.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9491777 mon.a (mon.0) 1020 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9494138 mon.a (mon.0) 1021 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9496505 mon.a (mon.0) 1022 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.949921 mon.a (mon.0) 1023 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9501505 mon.a (mon.0) 1024 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9503846 mon.a (mon.0) 1025 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.950613 mon.a (mon.0) 1026 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:50:57.251 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9508612 mon.a (mon.0) 1027 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:50:57.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.951139 mon.a (mon.0) 1028 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:50:57.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9513726 mon.a (mon.0) 1029 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:50:57.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9516006 mon.a (mon.0) 1030 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:50:57.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213055.9518666 mon.a (mon.0) 1031 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 14}]: dispatch 2023-07-13T01:50:57.252 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:56 smithi154 bash[27744]: audit 1689213056.694386 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.154:0/1824214285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:50:57.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9377358 mon.a (mon.0) 1014 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9444509 mon.e (mon.1) 13 : audit 1 from='client.? 172.21.15.154:0/3204038336' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]: dispatch 2023-07-13T01:50:57.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9476418 mon.a (mon.0) 1015 : audit 1 from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b402a96-4f59-48e1-8257-08007b9852db"}]': finished 2023-07-13T01:50:57.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: cluster 1689213055.9477296 mon.a (mon.0) 1016 : cluster 0 osdmap e23: 15 total, 0 up, 11 in 2023-07-13T01:50:57.298 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.947986 mon.a (mon.0) 1017 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9486926 mon.a (mon.0) 1018 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9489264 mon.a (mon.0) 1019 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9491777 mon.a (mon.0) 1020 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9494138 mon.a (mon.0) 1021 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9496505 mon.a (mon.0) 1022 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.949921 mon.a (mon.0) 1023 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9501505 mon.a (mon.0) 1024 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-13T01:50:57.299 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9503846 mon.a (mon.0) 1025 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.950613 mon.a (mon.0) 1026 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9508612 mon.a (mon.0) 1027 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.951139 mon.a (mon.0) 1028 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9513726 mon.a (mon.0) 1029 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 12}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9516006 mon.a (mon.0) 1030 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 13}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213055.9518666 mon.a (mon.0) 1031 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 14}]: dispatch 2023-07-13T01:50:57.300 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:56 smithi137 bash[27262]: audit 1689213056.694386 mon.c (mon.2) 9 : audit 0 from='client.? 172.21.15.154:0/1824214285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-13T01:50:57.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:50:57 smithi154 bash[27744]: cluster 1689213057.1133983 mgr.a (mgr.14152) 700 : cluster 0 pgmap v585: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:57.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:57 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:50:57.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:57 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:58.000 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:57 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:50:58.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:50:57 smithi103 bash[27315]: cluster 1689213057.1133983 mgr.a (mgr.14152) 700 : cluster 0 pgmap v585: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:58.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:50:57 smithi084 bash[27323]: cluster 1689213057.1133983 mgr.a (mgr.14152) 700 : cluster 0 pgmap v585: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:58.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:50:57 smithi022 bash[26979]: cluster 1689213057.1133983 mgr.a (mgr.14152) 700 : cluster 0 pgmap v585: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:58.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:50:57 smithi137 bash[27262]: cluster 1689213057.1133983 mgr.a (mgr.14152) 700 : cluster 0 pgmap v585: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:50:59.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:59 smithi154 bash[40886]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:59.525 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:59 smithi154 bash[40886]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:50:59.526 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:59 smithi154 bash[40886]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:50:59.526 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:50:59 smithi154 bash[40886]: --> Failed to activate any OSD(s) 2023-07-13T01:51:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:00 smithi154 bash[27744]: cluster 1689213059.1139696 mgr.a (mgr.14152) 701 : cluster 0 pgmap v586: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:00 smithi137 bash[27262]: cluster 1689213059.1139696 mgr.a (mgr.14152) 701 : cluster 0 pgmap v586: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:00.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:00 smithi103 bash[27315]: cluster 1689213059.1139696 mgr.a (mgr.14152) 701 : cluster 0 pgmap v586: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:00.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:00 smithi084 bash[27323]: cluster 1689213059.1139696 mgr.a (mgr.14152) 701 : cluster 0 pgmap v586: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:00.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:00 smithi022 bash[26979]: cluster 1689213059.1139696 mgr.a (mgr.14152) 701 : cluster 0 pgmap v586: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:01.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:01 smithi154 bash[41532]: debug 2023-07-13T01:51:01.381+0000 7f0ab255a700 1 -- 172.21.15.154:0/3541818044 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c9bfa22d00 con 0x55c9bfa78c00 2023-07-13T01:51:01.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:01 smithi154 bash[41532]: debug 2023-07-13T01:51:01.381+0000 7f0abb6df640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:02.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:02 smithi154 bash[27744]: cluster 1689213061.1144671 mgr.a (mgr.14152) 702 : cluster 0 pgmap v587: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:02.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:02 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:02.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:02 smithi137 bash[27262]: cluster 1689213061.1144671 mgr.a (mgr.14152) 702 : cluster 0 pgmap v587: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:02.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:02 smithi103 bash[27315]: cluster 1689213061.1144671 mgr.a (mgr.14152) 702 : cluster 0 pgmap v587: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:02.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:02 smithi084 bash[27323]: cluster 1689213061.1144671 mgr.a (mgr.14152) 702 : cluster 0 pgmap v587: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:02.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:02 smithi022 bash[26979]: cluster 1689213061.1144671 mgr.a (mgr.14152) 702 : cluster 0 pgmap v587: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:04.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:04 smithi154 bash[27744]: cluster 1689213063.115093 mgr.a (mgr.14152) 703 : cluster 0 pgmap v588: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:04.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:04 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:51:04.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:04 smithi137 bash[27262]: cluster 1689213063.115093 mgr.a (mgr.14152) 703 : cluster 0 pgmap v588: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:04.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:04 smithi103 bash[27315]: cluster 1689213063.115093 mgr.a (mgr.14152) 703 : cluster 0 pgmap v588: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:04.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:04 smithi084 bash[27323]: cluster 1689213063.115093 mgr.a (mgr.14152) 703 : cluster 0 pgmap v588: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:04.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:04 smithi022 bash[26979]: cluster 1689213063.115093 mgr.a (mgr.14152) 703 : cluster 0 pgmap v588: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:05.999 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:05 smithi154 bash[27744]: cluster 1689213065.1157436 mgr.a (mgr.14152) 704 : cluster 0 pgmap v589: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:06.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:05 smithi103 bash[27315]: cluster 1689213065.1157436 mgr.a (mgr.14152) 704 : cluster 0 pgmap v589: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:06.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:05 smithi084 bash[27323]: cluster 1689213065.1157436 mgr.a (mgr.14152) 704 : cluster 0 pgmap v589: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:05 smithi022 bash[26979]: cluster 1689213065.1157436 mgr.a (mgr.14152) 704 : cluster 0 pgmap v589: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:06.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:05 smithi137 bash[27262]: cluster 1689213065.1157436 mgr.a (mgr.14152) 704 : cluster 0 pgmap v589: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:06.749 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:06 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:51:06.749 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:06 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:06.749 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:06 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:07.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:07 smithi154 bash[41846]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:07.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:07 smithi154 bash[41846]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:08.000 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:07 smithi154 bash[41846]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:08.000 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:07 smithi154 bash[41846]: --> Failed to activate any OSD(s) 2023-07-13T01:51:08.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:08 smithi154 bash[27744]: cluster 1689213067.116407 mgr.a (mgr.14152) 705 : cluster 0 pgmap v590: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:08.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:08 smithi137 bash[27262]: cluster 1689213067.116407 mgr.a (mgr.14152) 705 : cluster 0 pgmap v590: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:08.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:08 smithi103 bash[27315]: cluster 1689213067.116407 mgr.a (mgr.14152) 705 : cluster 0 pgmap v590: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:08.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:08 smithi084 bash[27323]: cluster 1689213067.116407 mgr.a (mgr.14152) 705 : cluster 0 pgmap v590: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:08 smithi022 bash[26979]: cluster 1689213067.116407 mgr.a (mgr.14152) 705 : cluster 0 pgmap v590: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:10.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:10 smithi154 bash[27744]: cluster 1689213069.1169345 mgr.a (mgr.14152) 706 : cluster 0 pgmap v591: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:10.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:10 smithi137 bash[27262]: cluster 1689213069.1169345 mgr.a (mgr.14152) 706 : cluster 0 pgmap v591: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:10.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:10 smithi103 bash[27315]: cluster 1689213069.1169345 mgr.a (mgr.14152) 706 : cluster 0 pgmap v591: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:10.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:10 smithi084 bash[27323]: cluster 1689213069.1169345 mgr.a (mgr.14152) 706 : cluster 0 pgmap v591: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:10.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:10 smithi022 bash[26979]: cluster 1689213069.1169345 mgr.a (mgr.14152) 706 : cluster 0 pgmap v591: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:10.765 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:10 smithi154 bash[42030]: debug 2023-07-13T01:51:10.368+0000 7f34702b6640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:11.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:11 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:12.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:12 smithi154 bash[27744]: cluster 1689213071.1174562 mgr.a (mgr.14152) 707 : cluster 0 pgmap v592: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:12.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:12 smithi154 bash[27744]: audit 1689213071.541522 mon.a (mon.0) 1032 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.14"}]: dispatch 2023-07-13T01:51:12.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:12 smithi154 bash[27744]: audit 1689213071.5432715 mon.a (mon.0) 1033 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:12.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:12 smithi137 bash[27262]: cluster 1689213071.1174562 mgr.a (mgr.14152) 707 : cluster 0 pgmap v592: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:12.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:12 smithi137 bash[27262]: audit 1689213071.541522 mon.a (mon.0) 1032 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.14"}]: dispatch 2023-07-13T01:51:12.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:12 smithi137 bash[27262]: audit 1689213071.5432715 mon.a (mon.0) 1033 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:12.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:12 smithi103 bash[27315]: cluster 1689213071.1174562 mgr.a (mgr.14152) 707 : cluster 0 pgmap v592: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:12.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:12 smithi103 bash[27315]: audit 1689213071.541522 mon.a (mon.0) 1032 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.14"}]: dispatch 2023-07-13T01:51:12.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:12 smithi103 bash[27315]: audit 1689213071.5432715 mon.a (mon.0) 1033 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:12.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:12 smithi084 bash[27323]: cluster 1689213071.1174562 mgr.a (mgr.14152) 707 : cluster 0 pgmap v592: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:12.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:12 smithi084 bash[27323]: audit 1689213071.541522 mon.a (mon.0) 1032 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.14"}]: dispatch 2023-07-13T01:51:12.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:12 smithi084 bash[27323]: audit 1689213071.5432715 mon.a (mon.0) 1033 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:12.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:12 smithi022 bash[26979]: cluster 1689213071.1174562 mgr.a (mgr.14152) 707 : cluster 0 pgmap v592: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:12.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:12 smithi022 bash[26979]: audit 1689213071.541522 mon.a (mon.0) 1032 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.14"}]: dispatch 2023-07-13T01:51:12.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:12 smithi022 bash[26979]: audit 1689213071.5432715 mon.a (mon.0) 1033 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:13.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:13 smithi154 bash[27744]: cephadm 1689213071.5444403 mgr.a (mgr.14152) 708 : cephadm 1 Deploying daemon osd.14 on smithi154 2023-07-13T01:51:13.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:13 smithi137 bash[27262]: cephadm 1689213071.5444403 mgr.a (mgr.14152) 708 : cephadm 1 Deploying daemon osd.14 on smithi154 2023-07-13T01:51:13.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:13 smithi103 bash[27315]: cephadm 1689213071.5444403 mgr.a (mgr.14152) 708 : cephadm 1 Deploying daemon osd.14 on smithi154 2023-07-13T01:51:13.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:13 smithi084 bash[27323]: cephadm 1689213071.5444403 mgr.a (mgr.14152) 708 : cephadm 1 Deploying daemon osd.14 on smithi154 2023-07-13T01:51:13.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:13 smithi022 bash[26979]: cephadm 1689213071.5444403 mgr.a (mgr.14152) 708 : cephadm 1 Deploying daemon osd.14 on smithi154 2023-07-13T01:51:14.450 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:14 smithi154 bash[27744]: cluster 1689213073.1179712 mgr.a (mgr.14152) 709 : cluster 0 pgmap v593: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:14.450 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:14 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:51:14.451 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:14 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:14.451 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:14 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:14.451 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:14 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:51:14.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:14 smithi137 bash[27262]: cluster 1689213073.1179712 mgr.a (mgr.14152) 709 : cluster 0 pgmap v593: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:14.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:14 smithi103 bash[27315]: cluster 1689213073.1179712 mgr.a (mgr.14152) 709 : cluster 0 pgmap v593: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:14.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:14 smithi084 bash[27323]: cluster 1689213073.1179712 mgr.a (mgr.14152) 709 : cluster 0 pgmap v593: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:14.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:14 smithi022 bash[26979]: cluster 1689213073.1179712 mgr.a (mgr.14152) 709 : cluster 0 pgmap v593: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:15.998 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:15 smithi154 bash[27744]: cluster 1689213075.1184769 mgr.a (mgr.14152) 710 : cluster 0 pgmap v594: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:16.096 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:15 smithi103 bash[27315]: cluster 1689213075.1184769 mgr.a (mgr.14152) 710 : cluster 0 pgmap v594: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:16.137 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:15 smithi084 bash[27323]: cluster 1689213075.1184769 mgr.a (mgr.14152) 710 : cluster 0 pgmap v594: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:16.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:15 smithi022 bash[26979]: cluster 1689213075.1184769 mgr.a (mgr.14152) 710 : cluster 0 pgmap v594: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:16.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:15 smithi137 bash[27262]: cluster 1689213075.1184769 mgr.a (mgr.14152) 710 : cluster 0 pgmap v594: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:16.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:16 smithi154 bash[42501]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:16.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:16 smithi154 bash[42501]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:16.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:16 smithi154 bash[42501]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:16.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:16 smithi154 bash[42501]: --> Failed to activate any OSD(s) 2023-07-13T01:51:18.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:18 smithi154 bash[27744]: cluster 1689213077.118976 mgr.a (mgr.14152) 711 : cluster 0 pgmap v595: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:18.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:18 smithi154 bash[27744]: audit 1689213077.6141324 mon.a (mon.0) 1034 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:18 smithi154 bash[27744]: audit 1689213077.6176798 mon.a (mon.0) 1035 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:18.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:18 smithi154 bash[27744]: audit 1689213077.6234708 mon.a (mon.0) 1036 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:18 smithi137 bash[27262]: cluster 1689213077.118976 mgr.a (mgr.14152) 711 : cluster 0 pgmap v595: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:18.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:18 smithi137 bash[27262]: audit 1689213077.6141324 mon.a (mon.0) 1034 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:18 smithi137 bash[27262]: audit 1689213077.6176798 mon.a (mon.0) 1035 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:18.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:18 smithi137 bash[27262]: audit 1689213077.6234708 mon.a (mon.0) 1036 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:18 smithi103 bash[27315]: cluster 1689213077.118976 mgr.a (mgr.14152) 711 : cluster 0 pgmap v595: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:18.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:18 smithi103 bash[27315]: audit 1689213077.6141324 mon.a (mon.0) 1034 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:18 smithi103 bash[27315]: audit 1689213077.6176798 mon.a (mon.0) 1035 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:18.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:18 smithi103 bash[27315]: audit 1689213077.6234708 mon.a (mon.0) 1036 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:18 smithi084 bash[27323]: cluster 1689213077.118976 mgr.a (mgr.14152) 711 : cluster 0 pgmap v595: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:18.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:18 smithi084 bash[27323]: audit 1689213077.6141324 mon.a (mon.0) 1034 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:18 smithi084 bash[27323]: audit 1689213077.6176798 mon.a (mon.0) 1035 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:18.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:18 smithi084 bash[27323]: audit 1689213077.6234708 mon.a (mon.0) 1036 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:18 smithi022 bash[26979]: cluster 1689213077.118976 mgr.a (mgr.14152) 711 : cluster 0 pgmap v595: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:18.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:18 smithi022 bash[26979]: audit 1689213077.6141324 mon.a (mon.0) 1034 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:18 smithi022 bash[26979]: audit 1689213077.6176798 mon.a (mon.0) 1035 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:18.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:18 smithi022 bash[26979]: audit 1689213077.6234708 mon.a (mon.0) 1036 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:18.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:18 smithi154 bash[42697]: debug 2023-07-13T01:51:18.908+0000 7f85cd426700 1 -- 172.21.15.154:0/634608308 <== mon.4 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e9a77dad00 con 0x55e9a7830800 2023-07-13T01:51:18.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:18 smithi154 bash[42697]: debug 2023-07-13T01:51:18.908+0000 7f85d65ab640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:20.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:20 smithi154 bash[27744]: cluster 1689213079.1194322 mgr.a (mgr.14152) 712 : cluster 0 pgmap v596: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:20.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:20 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:20.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:20 smithi137 bash[27262]: cluster 1689213079.1194322 mgr.a (mgr.14152) 712 : cluster 0 pgmap v596: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:20.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:20 smithi103 bash[27315]: cluster 1689213079.1194322 mgr.a (mgr.14152) 712 : cluster 0 pgmap v596: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:20.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:20 smithi084 bash[27323]: cluster 1689213079.1194322 mgr.a (mgr.14152) 712 : cluster 0 pgmap v596: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:20.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:20 smithi022 bash[26979]: cluster 1689213079.1194322 mgr.a (mgr.14152) 712 : cluster 0 pgmap v596: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:22.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:22 smithi154 bash[27744]: cluster 1689213081.1200702 mgr.a (mgr.14152) 713 : cluster 0 pgmap v597: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:22.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:22 smithi137 bash[27262]: cluster 1689213081.1200702 mgr.a (mgr.14152) 713 : cluster 0 pgmap v597: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:22.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:22 smithi103 bash[27315]: cluster 1689213081.1200702 mgr.a (mgr.14152) 713 : cluster 0 pgmap v597: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:22.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:22 smithi084 bash[27323]: cluster 1689213081.1200702 mgr.a (mgr.14152) 713 : cluster 0 pgmap v597: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:22.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:22 smithi022 bash[26979]: cluster 1689213081.1200702 mgr.a (mgr.14152) 713 : cluster 0 pgmap v597: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:23.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:23 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:51:24.444 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:24 smithi154 bash[27744]: cluster 1689213083.1206236 mgr.a (mgr.14152) 714 : cluster 0 pgmap v598: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:24.444 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:24 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:51:24.445 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:24 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:24.445 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:24 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:24.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:24 smithi137 bash[27262]: cluster 1689213083.1206236 mgr.a (mgr.14152) 714 : cluster 0 pgmap v598: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:24.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:24 smithi103 bash[27315]: cluster 1689213083.1206236 mgr.a (mgr.14152) 714 : cluster 0 pgmap v598: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:24.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:24 smithi084 bash[27323]: cluster 1689213083.1206236 mgr.a (mgr.14152) 714 : cluster 0 pgmap v598: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:24.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:24 smithi022 bash[26979]: cluster 1689213083.1206236 mgr.a (mgr.14152) 714 : cluster 0 pgmap v598: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:26.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:26 smithi103 bash[27315]: audit 1689213085.0991876 mon.a (mon.0) 1037 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:26 smithi103 bash[27315]: audit 1689213085.1062973 mon.a (mon.0) 1038 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:26 smithi103 bash[27315]: cluster 1689213085.1210704 mgr.a (mgr.14152) 715 : cluster 0 pgmap v599: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:26.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:26 smithi103 bash[27315]: audit 1689213085.579027 mon.a (mon.0) 1039 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:26.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:26 smithi103 bash[27315]: audit 1689213085.5807316 mon.a (mon.0) 1040 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:26.348 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:26 smithi103 bash[27315]: audit 1689213085.5916257 mon.a (mon.0) 1041 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:26 smithi084 bash[27323]: audit 1689213085.0991876 mon.a (mon.0) 1037 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:26 smithi084 bash[27323]: audit 1689213085.1062973 mon.a (mon.0) 1038 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:26 smithi084 bash[27323]: cluster 1689213085.1210704 mgr.a (mgr.14152) 715 : cluster 0 pgmap v599: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:26.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:26 smithi084 bash[27323]: audit 1689213085.579027 mon.a (mon.0) 1039 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:26.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:26 smithi084 bash[27323]: audit 1689213085.5807316 mon.a (mon.0) 1040 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:26.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:26 smithi084 bash[27323]: audit 1689213085.5916257 mon.a (mon.0) 1041 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:26 smithi022 bash[26979]: audit 1689213085.0991876 mon.a (mon.0) 1037 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:26 smithi022 bash[26979]: audit 1689213085.1062973 mon.a (mon.0) 1038 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:26 smithi022 bash[26979]: cluster 1689213085.1210704 mgr.a (mgr.14152) 715 : cluster 0 pgmap v599: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:26.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:26 smithi022 bash[26979]: audit 1689213085.579027 mon.a (mon.0) 1039 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:26.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:26 smithi022 bash[26979]: audit 1689213085.5807316 mon.a (mon.0) 1040 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:26.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:26 smithi022 bash[26979]: audit 1689213085.5916257 mon.a (mon.0) 1041 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:26 smithi154 bash[27744]: audit 1689213085.0991876 mon.a (mon.0) 1037 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:26 smithi154 bash[27744]: audit 1689213085.1062973 mon.a (mon.0) 1038 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:26 smithi154 bash[27744]: cluster 1689213085.1210704 mgr.a (mgr.14152) 715 : cluster 0 pgmap v599: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:26.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:26 smithi154 bash[27744]: audit 1689213085.579027 mon.a (mon.0) 1039 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:26.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:26 smithi154 bash[27744]: audit 1689213085.5807316 mon.a (mon.0) 1040 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:26.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:26 smithi154 bash[27744]: audit 1689213085.5916257 mon.a (mon.0) 1041 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:26 smithi137 bash[27262]: audit 1689213085.0991876 mon.a (mon.0) 1037 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:26 smithi137 bash[27262]: audit 1689213085.1062973 mon.a (mon.0) 1038 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:26.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:26 smithi137 bash[27262]: cluster 1689213085.1210704 mgr.a (mgr.14152) 715 : cluster 0 pgmap v599: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:26.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:26 smithi137 bash[27262]: audit 1689213085.579027 mon.a (mon.0) 1039 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:26.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:26 smithi137 bash[27262]: audit 1689213085.5807316 mon.a (mon.0) 1040 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:26.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:26 smithi137 bash[27262]: audit 1689213085.5916257 mon.a (mon.0) 1041 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:27.343 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:27 smithi154 bash[27744]: cluster 1689213085.5841398 mgr.a (mgr.14152) 716 : cluster 0 pgmap v600: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.343 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:27 smithi154 bash[27744]: cluster 1689213085.5845528 mgr.a (mgr.14152) 717 : cluster 0 pgmap v601: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:27 smithi103 bash[27315]: cluster 1689213085.5841398 mgr.a (mgr.14152) 716 : cluster 0 pgmap v600: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:27 smithi103 bash[27315]: cluster 1689213085.5845528 mgr.a (mgr.14152) 717 : cluster 0 pgmap v601: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:27 smithi084 bash[27323]: cluster 1689213085.5841398 mgr.a (mgr.14152) 716 : cluster 0 pgmap v600: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:27 smithi084 bash[27323]: cluster 1689213085.5845528 mgr.a (mgr.14152) 717 : cluster 0 pgmap v601: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:27 smithi022 bash[26979]: cluster 1689213085.5841398 mgr.a (mgr.14152) 716 : cluster 0 pgmap v600: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:27 smithi022 bash[26979]: cluster 1689213085.5845528 mgr.a (mgr.14152) 717 : cluster 0 pgmap v601: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:27 smithi137 bash[27262]: cluster 1689213085.5841398 mgr.a (mgr.14152) 716 : cluster 0 pgmap v600: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:27 smithi137 bash[27262]: cluster 1689213085.5845528 mgr.a (mgr.14152) 717 : cluster 0 pgmap v601: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:27.641 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:27 smithi154 bash[43526]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:27.641 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:27 smithi154 bash[43526]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:27.641 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:27 smithi154 bash[43526]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:27.641 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:27 smithi154 bash[43526]: --> Failed to activate any OSD(s) 2023-07-13T01:51:29.384 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:29 smithi154 bash[27744]: cluster 1689213087.5850909 mgr.a (mgr.14152) 718 : cluster 0 pgmap v602: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:29.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:29 smithi084 bash[27323]: cluster 1689213087.5850909 mgr.a (mgr.14152) 718 : cluster 0 pgmap v602: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:29.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:29 smithi022 bash[26979]: cluster 1689213087.5850909 mgr.a (mgr.14152) 718 : cluster 0 pgmap v602: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:29.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:29 smithi137 bash[27262]: cluster 1689213087.5850909 mgr.a (mgr.14152) 718 : cluster 0 pgmap v602: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:29.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:29 smithi103 bash[27315]: cluster 1689213087.5850909 mgr.a (mgr.14152) 718 : cluster 0 pgmap v602: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:29.707 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:29 smithi154 bash[43869]: debug 2023-07-13T01:51:29.496+0000 7fad38ac1700 1 -- 172.21.15.154:0/124560871 <== mon.3 v2:172.21.15.137:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56388f2a4d00 con 0x56388f2fb000 2023-07-13T01:51:29.707 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:29 smithi154 bash[43869]: debug 2023-07-13T01:51:29.496+0000 7fad41c46640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:30.538 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 14 on host 'smithi154' 2023-07-13T01:51:30.999 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:30 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:31.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:31 smithi084 bash[27323]: cluster 1689213089.5856075 mgr.a (mgr.14152) 719 : cluster 0 pgmap v603: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:31.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:31 smithi084 bash[27323]: audit 1689213090.4853868 mon.a (mon.0) 1042 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:31.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:31 smithi084 bash[27323]: audit 1689213090.4905915 mon.a (mon.0) 1043 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:31 smithi084 bash[27323]: audit 1689213090.497605 mon.a (mon.0) 1044 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:31 smithi022 bash[26979]: cluster 1689213089.5856075 mgr.a (mgr.14152) 719 : cluster 0 pgmap v603: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:31.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:31 smithi022 bash[26979]: audit 1689213090.4853868 mon.a (mon.0) 1042 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:31.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:31 smithi022 bash[26979]: audit 1689213090.4905915 mon.a (mon.0) 1043 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:31 smithi022 bash[26979]: audit 1689213090.497605 mon.a (mon.0) 1044 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.491 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:31 smithi154 bash[27744]: cluster 1689213089.5856075 mgr.a (mgr.14152) 719 : cluster 0 pgmap v603: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:31.492 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:31 smithi154 bash[27744]: audit 1689213090.4853868 mon.a (mon.0) 1042 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:31.492 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:31 smithi154 bash[27744]: audit 1689213090.4905915 mon.a (mon.0) 1043 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.492 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:31 smithi154 bash[27744]: audit 1689213090.497605 mon.a (mon.0) 1044 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.493 DEBUG:teuthology.orchestra.run.smithi154:osd.14> sudo journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service 2023-07-13T01:51:31.496 INFO:tasks.cephadm:Waiting for 15 OSDs to come up... 2023-07-13T01:51:31.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:51:31.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:31 smithi137 bash[27262]: cluster 1689213089.5856075 mgr.a (mgr.14152) 719 : cluster 0 pgmap v603: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:31.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:31 smithi137 bash[27262]: audit 1689213090.4853868 mon.a (mon.0) 1042 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:31.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:31 smithi137 bash[27262]: audit 1689213090.4905915 mon.a (mon.0) 1043 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:31 smithi137 bash[27262]: audit 1689213090.497605 mon.a (mon.0) 1044 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:31 smithi103 bash[27315]: cluster 1689213089.5856075 mgr.a (mgr.14152) 719 : cluster 0 pgmap v603: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:31.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:31 smithi103 bash[27315]: audit 1689213090.4853868 mon.a (mon.0) 1042 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:51:31.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:31 smithi103 bash[27315]: audit 1689213090.4905915 mon.a (mon.0) 1043 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:31.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:31 smithi103 bash[27315]: audit 1689213090.497605 mon.a (mon.0) 1044 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:32.044 INFO:journalctl@ceph.osd.14.smithi154.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-07-13T01:51:33.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:33 smithi084 bash[27323]: cluster 1689213091.5861719 mgr.a (mgr.14152) 720 : cluster 0 pgmap v604: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:33.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:33 smithi022 bash[26979]: cluster 1689213091.5861719 mgr.a (mgr.14152) 720 : cluster 0 pgmap v604: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:33.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:33 smithi154 bash[27744]: cluster 1689213091.5861719 mgr.a (mgr.14152) 720 : cluster 0 pgmap v604: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:33.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:33 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:51:33.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:33 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:51:33.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:33 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:33.500 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:33 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:33.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:33 smithi137 bash[27262]: cluster 1689213091.5861719 mgr.a (mgr.14152) 720 : cluster 0 pgmap v604: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:33.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:33 smithi103 bash[27315]: cluster 1689213091.5861719 mgr.a (mgr.14152) 720 : cluster 0 pgmap v604: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:34.998 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:34 smithi154 bash[44268]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:34.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:34 smithi154 bash[44268]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:34.999 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:34 smithi154 bash[44268]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:35.000 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:34 smithi154 bash[44268]: --> Failed to activate any OSD(s) 2023-07-13T01:51:35.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:35 smithi084 bash[27323]: cluster 1689213093.5867467 mgr.a (mgr.14152) 721 : cluster 0 pgmap v605: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:35.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:35 smithi022 bash[26979]: cluster 1689213093.5867467 mgr.a (mgr.14152) 721 : cluster 0 pgmap v605: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:35.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:35 smithi154 bash[27744]: cluster 1689213093.5867467 mgr.a (mgr.14152) 721 : cluster 0 pgmap v605: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:35.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:35 smithi137 bash[27262]: cluster 1689213093.5867467 mgr.a (mgr.14152) 721 : cluster 0 pgmap v605: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:35.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:35 smithi103 bash[27315]: cluster 1689213093.5867467 mgr.a (mgr.14152) 721 : cluster 0 pgmap v605: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:36.199 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:51:36.855 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:36 smithi154 bash[44394]: debug 2023-07-13T01:51:36.752+0000 7fe15b85b700 1 -- 172.21.15.154:0/1788484430 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653296f6d00 con 0x56532974d000 2023-07-13T01:51:36.855 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:36 smithi154 bash[44394]: debug 2023-07-13T01:51:36.756+0000 7fe1649e0640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:36.855 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:36 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Scheduled restart job, restart counter is at 1. 2023-07-13T01:51:36.855 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:36 smithi154 systemd[1]: Stopped Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:36.856 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:36 smithi154 systemd[1]: Started Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:37.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:37 smithi084 bash[27323]: cluster 1689213095.587243 mgr.a (mgr.14152) 722 : cluster 0 pgmap v606: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:37.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:37 smithi022 bash[26979]: cluster 1689213095.587243 mgr.a (mgr.14152) 722 : cluster 0 pgmap v606: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:37.481 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:37 smithi154 bash[27744]: cluster 1689213095.587243 mgr.a (mgr.14152) 722 : cluster 0 pgmap v606: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:37.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:37 smithi137 bash[27262]: cluster 1689213095.587243 mgr.a (mgr.14152) 722 : cluster 0 pgmap v606: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:37.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:37 smithi103 bash[27315]: cluster 1689213095.587243 mgr.a (mgr.14152) 722 : cluster 0 pgmap v606: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:38.498 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:38 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:39.366 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:51:39.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:39 smithi084 bash[27323]: cluster 1689213097.5877976 mgr.a (mgr.14152) 723 : cluster 0 pgmap v607: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:39.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:39 smithi022 bash[26979]: cluster 1689213097.5877976 mgr.a (mgr.14152) 723 : cluster 0 pgmap v607: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:39.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:39 smithi154 bash[27744]: cluster 1689213097.5877976 mgr.a (mgr.14152) 723 : cluster 0 pgmap v607: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:39.499 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:39 smithi154 bash[44497]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:39.499 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:39 smithi154 bash[44497]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:39.499 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:39 smithi154 bash[44497]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:39.499 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:39 smithi154 bash[44497]: --> Failed to activate any OSD(s) 2023-07-13T01:51:39.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:39 smithi137 bash[27262]: cluster 1689213097.5877976 mgr.a (mgr.14152) 723 : cluster 0 pgmap v607: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:39.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:39 smithi103 bash[27315]: cluster 1689213097.5877976 mgr.a (mgr.14152) 723 : cluster 0 pgmap v607: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:40.144 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:51:40.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:40 smithi084 bash[27323]: audit 1689213099.3858707 mon.e (mon.1) 14 : audit 0 from='client.? 172.21.15.22:0/121448387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:40.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:40 smithi022 bash[26979]: audit 1689213099.3858707 mon.e (mon.1) 14 : audit 0 from='client.? 172.21.15.22:0/121448387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:40.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:40 smithi154 bash[27744]: audit 1689213099.3858707 mon.e (mon.1) 14 : audit 0 from='client.? 172.21.15.22:0/121448387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:40.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:40 smithi137 bash[27262]: audit 1689213099.3858707 mon.e (mon.1) 14 : audit 0 from='client.? 172.21.15.22:0/121448387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:40.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:40 smithi103 bash[27315]: audit 1689213099.3858707 mon.e (mon.1) 14 : audit 0 from='client.? 172.21.15.22:0/121448387' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:41.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:51:41.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:41 smithi084 bash[27323]: cluster 1689213099.588219 mgr.a (mgr.14152) 724 : cluster 0 pgmap v608: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:41.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:41 smithi022 bash[26979]: cluster 1689213099.588219 mgr.a (mgr.14152) 724 : cluster 0 pgmap v608: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:41.489 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:41 smithi154 bash[27744]: cluster 1689213099.588219 mgr.a (mgr.14152) 724 : cluster 0 pgmap v608: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:41.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:41 smithi137 bash[27262]: cluster 1689213099.588219 mgr.a (mgr.14152) 724 : cluster 0 pgmap v608: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:41.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:41 smithi103 bash[27315]: cluster 1689213099.588219 mgr.a (mgr.14152) 724 : cluster 0 pgmap v608: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:41.748 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:41 smithi154 bash[44770]: debug 2023-07-13T01:51:41.616+0000 7f20443b6700 1 -- 172.21.15.154:0/3325698807 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563ec23fad00 con 0x563ec2451000 2023-07-13T01:51:41.748 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:41 smithi154 bash[44770]: debug 2023-07-13T01:51:41.616+0000 7f204d53b640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:42.988 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:42 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:51:43.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:43 smithi154 bash[27744]: cluster 1689213101.5888102 mgr.a (mgr.14152) 725 : cluster 0 pgmap v609: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:43.276 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:43 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:51:43.276 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:43 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:43.276 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:43 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:43.277 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:43 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:43.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:43 smithi022 bash[26979]: cluster 1689213101.5888102 mgr.a (mgr.14152) 725 : cluster 0 pgmap v609: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:43.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:43 smithi137 bash[27262]: cluster 1689213101.5888102 mgr.a (mgr.14152) 725 : cluster 0 pgmap v609: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:43.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:43 smithi103 bash[27315]: cluster 1689213101.5888102 mgr.a (mgr.14152) 725 : cluster 0 pgmap v609: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:43.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:43 smithi084 bash[27323]: cluster 1689213101.5888102 mgr.a (mgr.14152) 725 : cluster 0 pgmap v609: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: cephadm 1689213103.137936 mgr.a (mgr.14152) 726 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:51:44.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1490912 mon.a (mon.0) 1045 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1612554 mon.a (mon.0) 1046 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1626537 mon.a (mon.0) 1047 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1637955 mon.a (mon.0) 1048 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1649642 mon.a (mon.0) 1049 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: cephadm 1689213103.1660101 mgr.a (mgr.14152) 727 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T01:51:44.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.173129 mon.a (mon.0) 1050 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1744845 mon.a (mon.0) 1051 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1754875 mon.a (mon.0) 1052 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: cluster 1689213103.1774342 mgr.a (mgr.14152) 728 : cluster 0 pgmap v610: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: cluster 1689213103.1776156 mgr.a (mgr.14152) 729 : cluster 0 pgmap v611: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:44 smithi022 bash[26979]: audit 1689213103.1831179 mon.a (mon.0) 1053 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: cephadm 1689213103.137936 mgr.a (mgr.14152) 726 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:51:44.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1490912 mon.a (mon.0) 1045 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1612554 mon.a (mon.0) 1046 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1626537 mon.a (mon.0) 1047 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1637955 mon.a (mon.0) 1048 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1649642 mon.a (mon.0) 1049 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: cephadm 1689213103.1660101 mgr.a (mgr.14152) 727 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T01:51:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.173129 mon.a (mon.0) 1050 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1744845 mon.a (mon.0) 1051 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1754875 mon.a (mon.0) 1052 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: cluster 1689213103.1774342 mgr.a (mgr.14152) 728 : cluster 0 pgmap v610: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: cluster 1689213103.1776156 mgr.a (mgr.14152) 729 : cluster 0 pgmap v611: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[27744]: audit 1689213103.1831179 mon.a (mon.0) 1053 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: cephadm 1689213103.137936 mgr.a (mgr.14152) 726 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:51:44.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1490912 mon.a (mon.0) 1045 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1612554 mon.a (mon.0) 1046 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1626537 mon.a (mon.0) 1047 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1637955 mon.a (mon.0) 1048 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1649642 mon.a (mon.0) 1049 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: cephadm 1689213103.1660101 mgr.a (mgr.14152) 727 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.173129 mon.a (mon.0) 1050 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1744845 mon.a (mon.0) 1051 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1754875 mon.a (mon.0) 1052 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: cluster 1689213103.1774342 mgr.a (mgr.14152) 728 : cluster 0 pgmap v610: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: cluster 1689213103.1776156 mgr.a (mgr.14152) 729 : cluster 0 pgmap v611: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:44 smithi137 bash[27262]: audit 1689213103.1831179 mon.a (mon.0) 1053 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: cephadm 1689213103.137936 mgr.a (mgr.14152) 726 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1490912 mon.a (mon.0) 1045 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1612554 mon.a (mon.0) 1046 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1626537 mon.a (mon.0) 1047 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1637955 mon.a (mon.0) 1048 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1649642 mon.a (mon.0) 1049 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: cephadm 1689213103.1660101 mgr.a (mgr.14152) 727 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T01:51:44.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.173129 mon.a (mon.0) 1050 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1744845 mon.a (mon.0) 1051 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:44.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1754875 mon.a (mon.0) 1052 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:44.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: cluster 1689213103.1774342 mgr.a (mgr.14152) 728 : cluster 0 pgmap v610: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: cluster 1689213103.1776156 mgr.a (mgr.14152) 729 : cluster 0 pgmap v611: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:44 smithi103 bash[27315]: audit 1689213103.1831179 mon.a (mon.0) 1053 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: cephadm 1689213103.137936 mgr.a (mgr.14152) 726 : cephadm 1 Detected new or changed devices on smithi154 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1490912 mon.a (mon.0) 1045 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1612554 mon.a (mon.0) 1046 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1626537 mon.a (mon.0) 1047 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1637955 mon.a (mon.0) 1048 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1649642 mon.a (mon.0) 1049 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: cephadm 1689213103.1660101 mgr.a (mgr.14152) 727 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T01:51:44.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.173129 mon.a (mon.0) 1050 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:44.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1744845 mon.a (mon.0) 1051 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:51:44.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1754875 mon.a (mon.0) 1052 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:51:44.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: cluster 1689213103.1774342 mgr.a (mgr.14152) 728 : cluster 0 pgmap v610: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: cluster 1689213103.1776156 mgr.a (mgr.14152) 729 : cluster 0 pgmap v611: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:44.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:44 smithi084 bash[27323]: audit 1689213103.1831179 mon.a (mon.0) 1053 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:51:45.248 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[45693]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:45.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[45693]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:45.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[45693]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:45.250 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:44 smithi154 bash[45693]: --> Failed to activate any OSD(s) 2023-07-13T01:51:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:51:45.973 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:45 smithi154 bash[27744]: cluster 1689213105.1780868 mgr.a (mgr.14152) 730 : cluster 0 pgmap v612: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:46.097 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:45 smithi103 bash[27315]: cluster 1689213105.1780868 mgr.a (mgr.14152) 730 : cluster 0 pgmap v612: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:46.136 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:45 smithi084 bash[27323]: cluster 1689213105.1780868 mgr.a (mgr.14152) 730 : cluster 0 pgmap v612: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:46.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:45 smithi022 bash[26979]: cluster 1689213105.1780868 mgr.a (mgr.14152) 730 : cluster 0 pgmap v612: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:46.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:46 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Failed with result 'exit-code'. 2023-07-13T01:51:46.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:45 smithi137 bash[27262]: cluster 1689213105.1780868 mgr.a (mgr.14152) 730 : cluster 0 pgmap v612: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:47.377 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:47 smithi154 bash[45873]: debug 2023-07-13T01:51:47.163+0000 7fd11124b700 1 -- 172.21.15.154:0/378335941 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5579bb31ed00 con 0x5579bb374c00 2023-07-13T01:51:47.378 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:47 smithi154 bash[45873]: debug 2023-07-13T01:51:47.163+0000 7fd11a3d0640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:48.221 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:47 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:48.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:48 smithi154 bash[27744]: cluster 1689213107.1786325 mgr.a (mgr.14152) 731 : cluster 0 pgmap v613: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:48.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:48 smithi137 bash[27262]: cluster 1689213107.1786325 mgr.a (mgr.14152) 731 : cluster 0 pgmap v613: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:48.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:48 smithi103 bash[27315]: cluster 1689213107.1786325 mgr.a (mgr.14152) 731 : cluster 0 pgmap v613: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:48.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:48 smithi084 bash[27323]: cluster 1689213107.1786325 mgr.a (mgr.14152) 731 : cluster 0 pgmap v613: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:48.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:48 smithi022 bash[26979]: cluster 1689213107.1786325 mgr.a (mgr.14152) 731 : cluster 0 pgmap v613: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:49.332 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:51:50.064 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:51:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:50 smithi022 bash[26979]: cluster 1689213109.179158 mgr.a (mgr.14152) 732 : cluster 0 pgmap v614: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:50 smithi022 bash[26979]: audit 1689213109.3443477 mon.a (mon.0) 1054 : audit 0 from='client.? 172.21.15.22:0/3540928693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:50.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:51:50 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:51:50.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:50 smithi154 bash[27744]: cluster 1689213109.179158 mgr.a (mgr.14152) 732 : cluster 0 pgmap v614: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:50.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:50 smithi154 bash[27744]: audit 1689213109.3443477 mon.a (mon.0) 1054 : audit 0 from='client.? 172.21.15.22:0/3540928693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:50.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:50 smithi137 bash[27262]: cluster 1689213109.179158 mgr.a (mgr.14152) 732 : cluster 0 pgmap v614: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:50.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:50 smithi137 bash[27262]: audit 1689213109.3443477 mon.a (mon.0) 1054 : audit 0 from='client.? 172.21.15.22:0/3540928693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:50.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:50 smithi103 bash[27315]: cluster 1689213109.179158 mgr.a (mgr.14152) 732 : cluster 0 pgmap v614: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:50.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:50 smithi103 bash[27315]: audit 1689213109.3443477 mon.a (mon.0) 1054 : audit 0 from='client.? 172.21.15.22:0/3540928693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:50.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:50 smithi084 bash[27323]: cluster 1689213109.179158 mgr.a (mgr.14152) 732 : cluster 0 pgmap v614: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:50.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:50 smithi084 bash[27323]: audit 1689213109.3443477 mon.a (mon.0) 1054 : audit 0 from='client.? 172.21.15.22:0/3540928693' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:51.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:51:52.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:52 smithi154 bash[27744]: cluster 1689213111.1797016 mgr.a (mgr.14152) 733 : cluster 0 pgmap v615: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:52.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:52 smithi137 bash[27262]: cluster 1689213111.1797016 mgr.a (mgr.14152) 733 : cluster 0 pgmap v615: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:52.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:52 smithi103 bash[27315]: cluster 1689213111.1797016 mgr.a (mgr.14152) 733 : cluster 0 pgmap v615: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:52.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:52 smithi084 bash[27323]: cluster 1689213111.1797016 mgr.a (mgr.14152) 733 : cluster 0 pgmap v615: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:52.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:52 smithi022 bash[26979]: cluster 1689213111.1797016 mgr.a (mgr.14152) 733 : cluster 0 pgmap v615: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:53.248 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:52 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:51:53.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:52 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:53.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:52 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:54.500 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:54 smithi154 bash[46130]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:54.501 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:54 smithi154 bash[46130]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:54.501 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:54 smithi154 bash[46130]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:54.501 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:54 smithi154 bash[46130]: --> Failed to activate any OSD(s) 2023-07-13T01:51:54.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:54 smithi154 bash[27744]: cluster 1689213113.1802032 mgr.a (mgr.14152) 734 : cluster 0 pgmap v616: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:54.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:54 smithi137 bash[27262]: cluster 1689213113.1802032 mgr.a (mgr.14152) 734 : cluster 0 pgmap v616: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:54.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:54 smithi103 bash[27315]: cluster 1689213113.1802032 mgr.a (mgr.14152) 734 : cluster 0 pgmap v616: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:54.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:54 smithi084 bash[27323]: cluster 1689213113.1802032 mgr.a (mgr.14152) 734 : cluster 0 pgmap v616: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:54.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:54 smithi022 bash[26979]: cluster 1689213113.1802032 mgr.a (mgr.14152) 734 : cluster 0 pgmap v616: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:55.759 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:51:55.952 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:55 smithi154 bash[27744]: cluster 1689213115.1807816 mgr.a (mgr.14152) 735 : cluster 0 pgmap v617: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:55.952 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:55 smithi154 bash[46233]: debug 2023-07-13T01:51:55.727+0000 7f7d16817700 1 -- 172.21.15.154:0/873302607 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5577809c0d00 con 0x557780a17000 2023-07-13T01:51:55.952 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:55 smithi154 bash[46233]: debug 2023-07-13T01:51:55.727+0000 7f7d1f99c640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:51:56.096 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:55 smithi103 bash[27315]: cluster 1689213115.1807816 mgr.a (mgr.14152) 735 : cluster 0 pgmap v617: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:56.136 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:55 smithi084 bash[27323]: cluster 1689213115.1807816 mgr.a (mgr.14152) 735 : cluster 0 pgmap v617: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:56.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:55 smithi022 bash[26979]: cluster 1689213115.1807816 mgr.a (mgr.14152) 735 : cluster 0 pgmap v617: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:56.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:55 smithi137 bash[27262]: cluster 1689213115.1807816 mgr.a (mgr.14152) 735 : cluster 0 pgmap v617: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:56.325 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:56 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Scheduled restart job, restart counter is at 2. 2023-07-13T01:51:56.325 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:56 smithi154 systemd[1]: Stopped Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:56.325 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:56 smithi154 systemd[1]: Started Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:51:57.248 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:57 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:51:58.467 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:58 smithi154 bash[27744]: cluster 1689213117.1812882 mgr.a (mgr.14152) 736 : cluster 0 pgmap v618: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:58.468 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:58 smithi154 bash[46347]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:58.468 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:58 smithi154 bash[46347]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:51:58.468 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:58 smithi154 bash[46347]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:51:58.468 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:51:58 smithi154 bash[46347]: --> Failed to activate any OSD(s) 2023-07-13T01:51:58.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:58 smithi137 bash[27262]: cluster 1689213117.1812882 mgr.a (mgr.14152) 736 : cluster 0 pgmap v618: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:58.575 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:58 smithi022 bash[26979]: cluster 1689213117.1812882 mgr.a (mgr.14152) 736 : cluster 0 pgmap v618: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:58.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:58 smithi103 bash[27315]: cluster 1689213117.1812882 mgr.a (mgr.14152) 736 : cluster 0 pgmap v618: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:58.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:58 smithi084 bash[27323]: cluster 1689213117.1812882 mgr.a (mgr.14152) 736 : cluster 0 pgmap v618: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:51:59.006 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:51:59.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:51:59 smithi022 bash[26979]: audit 1689213119.0187469 mon.a (mon.0) 1055 : audit 0 from='client.? 172.21.15.22:0/2579306359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:59.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:51:59 smithi154 bash[27744]: audit 1689213119.0187469 mon.a (mon.0) 1055 : audit 0 from='client.? 172.21.15.22:0/2579306359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:59.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:51:59 smithi137 bash[27262]: audit 1689213119.0187469 mon.a (mon.0) 1055 : audit 0 from='client.? 172.21.15.22:0/2579306359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:59.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:51:59 smithi103 bash[27315]: audit 1689213119.0187469 mon.a (mon.0) 1055 : audit 0 from='client.? 172.21.15.22:0/2579306359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:59.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:51:59 smithi084 bash[27323]: audit 1689213119.0187469 mon.a (mon.0) 1055 : audit 0 from='client.? 172.21.15.22:0/2579306359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:51:59.720 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:00.115 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:51:59 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:52:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:00 smithi154 bash[27744]: cluster 1689213119.1818018 mgr.a (mgr.14152) 737 : cluster 0 pgmap v619: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:00.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:00 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 6. 2023-07-13T01:52:00.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:00 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:00.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:00 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:00.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:00 smithi137 bash[27262]: cluster 1689213119.1818018 mgr.a (mgr.14152) 737 : cluster 0 pgmap v619: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:00 smithi103 bash[27315]: cluster 1689213119.1818018 mgr.a (mgr.14152) 737 : cluster 0 pgmap v619: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:00.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:00 smithi084 bash[27323]: cluster 1689213119.1818018 mgr.a (mgr.14152) 737 : cluster 0 pgmap v619: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:00.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:00 smithi022 bash[26979]: cluster 1689213119.1818018 mgr.a (mgr.14152) 737 : cluster 0 pgmap v619: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:00.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:01.186 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:01 smithi154 bash[46596]: debug 2023-07-13T01:52:01.071+0000 7f0f56b9b700 1 -- 172.21.15.154:0/2453320200 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5568f31ded00 con 0x5568f3234800 2023-07-13T01:52:01.187 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:01 smithi154 bash[46596]: debug 2023-07-13T01:52:01.071+0000 7f0f5fd20640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:01.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:02 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:02.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:02 smithi154 bash[27744]: cluster 1689213121.1823034 mgr.a (mgr.14152) 738 : cluster 0 pgmap v620: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:02.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:02 smithi154 bash[46631]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:02.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:02 smithi154 bash[46631]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:02.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:02 smithi154 bash[46631]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:02.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:02 smithi154 bash[46631]: --> Failed to activate any OSD(s) 2023-07-13T01:52:02.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:02 smithi137 bash[27262]: cluster 1689213121.1823034 mgr.a (mgr.14152) 738 : cluster 0 pgmap v620: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:02.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:02 smithi103 bash[27315]: cluster 1689213121.1823034 mgr.a (mgr.14152) 738 : cluster 0 pgmap v620: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:02.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:02 smithi084 bash[27323]: cluster 1689213121.1823034 mgr.a (mgr.14152) 738 : cluster 0 pgmap v620: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:02.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:02 smithi022 bash[26979]: cluster 1689213121.1823034 mgr.a (mgr.14152) 738 : cluster 0 pgmap v620: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:04.417 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:52:04.468 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:04 smithi154 bash[27744]: cluster 1689213123.1828434 mgr.a (mgr.14152) 739 : cluster 0 pgmap v621: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:04.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:04 smithi137 bash[27262]: cluster 1689213123.1828434 mgr.a (mgr.14152) 739 : cluster 0 pgmap v621: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:04.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:04 smithi103 bash[27315]: cluster 1689213123.1828434 mgr.a (mgr.14152) 739 : cluster 0 pgmap v621: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:04.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:04 smithi084 bash[27323]: cluster 1689213123.1828434 mgr.a (mgr.14152) 739 : cluster 0 pgmap v621: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:04.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:04 smithi022 bash[26979]: cluster 1689213123.1828434 mgr.a (mgr.14152) 739 : cluster 0 pgmap v621: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:04.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:04 smithi154 bash[46882]: debug 2023-07-13T01:52:04.579+0000 7f9cde2bf700 1 -- 172.21.15.154:0/2997353130 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dc02284d00 con 0x55dc022da800 2023-07-13T01:52:04.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:04 smithi154 bash[46882]: debug 2023-07-13T01:52:04.579+0000 7f9ce7444640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:05.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:04 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Failed with result 'exit-code'. 2023-07-13T01:52:05.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:05 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:06.096 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:05 smithi103 bash[27315]: cluster 1689213125.1834185 mgr.a (mgr.14152) 740 : cluster 0 pgmap v622: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:06.136 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:05 smithi084 bash[27323]: cluster 1689213125.1834185 mgr.a (mgr.14152) 740 : cluster 0 pgmap v622: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:06.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:05 smithi022 bash[26979]: cluster 1689213125.1834185 mgr.a (mgr.14152) 740 : cluster 0 pgmap v622: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:06.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:05 smithi154 bash[27744]: cluster 1689213125.1834185 mgr.a (mgr.14152) 740 : cluster 0 pgmap v622: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:06.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:05 smithi137 bash[27262]: cluster 1689213125.1834185 mgr.a (mgr.14152) 740 : cluster 0 pgmap v622: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:07.630 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:52:07.998 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:07 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:52:08.339 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:08.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:08 smithi154 bash[27744]: cluster 1689213127.1839216 mgr.a (mgr.14152) 741 : cluster 0 pgmap v623: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:08.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:08 smithi154 bash[27744]: audit 1689213127.6497595 mon.e (mon.1) 15 : audit 0 from='client.? 172.21.15.22:0/484613584' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:08.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:08 smithi137 bash[27262]: cluster 1689213127.1839216 mgr.a (mgr.14152) 741 : cluster 0 pgmap v623: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:08.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:08 smithi137 bash[27262]: audit 1689213127.6497595 mon.e (mon.1) 15 : audit 0 from='client.? 172.21.15.22:0/484613584' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:08.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:08 smithi103 bash[27315]: cluster 1689213127.1839216 mgr.a (mgr.14152) 741 : cluster 0 pgmap v623: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:08.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:08 smithi103 bash[27315]: audit 1689213127.6497595 mon.e (mon.1) 15 : audit 0 from='client.? 172.21.15.22:0/484613584' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:08.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:08 smithi084 bash[27323]: cluster 1689213127.1839216 mgr.a (mgr.14152) 741 : cluster 0 pgmap v623: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:08.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:08 smithi084 bash[27323]: audit 1689213127.6497595 mon.e (mon.1) 15 : audit 0 from='client.? 172.21.15.22:0/484613584' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:08 smithi022 bash[26979]: cluster 1689213127.1839216 mgr.a (mgr.14152) 741 : cluster 0 pgmap v623: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:08.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:08 smithi022 bash[26979]: audit 1689213127.6497595 mon.e (mon.1) 15 : audit 0 from='client.? 172.21.15.22:0/484613584' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:09.340 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:10.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:10 smithi154 bash[27744]: cluster 1689213129.1844678 mgr.a (mgr.14152) 742 : cluster 0 pgmap v624: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:10.501 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:10 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 10. 2023-07-13T01:52:10.501 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:10 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:10.501 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:10 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:10.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:10 smithi137 bash[27262]: cluster 1689213129.1844678 mgr.a (mgr.14152) 742 : cluster 0 pgmap v624: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:10.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:10 smithi103 bash[27315]: cluster 1689213129.1844678 mgr.a (mgr.14152) 742 : cluster 0 pgmap v624: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:10.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:10 smithi084 bash[27323]: cluster 1689213129.1844678 mgr.a (mgr.14152) 742 : cluster 0 pgmap v624: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:10.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:10 smithi022 bash[26979]: cluster 1689213129.1844678 mgr.a (mgr.14152) 742 : cluster 0 pgmap v624: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:11.748 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:11 smithi154 bash[47217]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:11.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:11 smithi154 bash[47217]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:11.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:11 smithi154 bash[47217]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:11.749 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:11 smithi154 bash[47217]: --> Failed to activate any OSD(s) 2023-07-13T01:52:12.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:12 smithi154 bash[27744]: cluster 1689213131.184983 mgr.a (mgr.14152) 743 : cluster 0 pgmap v625: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:12.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:12 smithi137 bash[27262]: cluster 1689213131.184983 mgr.a (mgr.14152) 743 : cluster 0 pgmap v625: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:12.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:12 smithi103 bash[27315]: cluster 1689213131.184983 mgr.a (mgr.14152) 743 : cluster 0 pgmap v625: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:12.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:12 smithi084 bash[27323]: cluster 1689213131.184983 mgr.a (mgr.14152) 743 : cluster 0 pgmap v625: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:12.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:12 smithi022 bash[26979]: cluster 1689213131.184983 mgr.a (mgr.14152) 743 : cluster 0 pgmap v625: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:13.298 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:13 smithi154 bash[47321]: debug 2023-07-13T01:52:13.151+0000 7f80bec0b700 1 -- 172.21.15.154:0/2017808887 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d0d4076d00 con 0x55d0d40ccc00 2023-07-13T01:52:13.298 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:13 smithi154 bash[47321]: debug 2023-07-13T01:52:13.151+0000 7f80c7d90640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:14.037 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:52:14.239 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:13 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:14.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:14 smithi022 bash[26979]: cluster 1689213133.185497 mgr.a (mgr.14152) 744 : cluster 0 pgmap v626: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:14.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:14 smithi154 bash[27744]: cluster 1689213133.185497 mgr.a (mgr.14152) 744 : cluster 0 pgmap v626: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:14.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:14 smithi137 bash[27262]: cluster 1689213133.185497 mgr.a (mgr.14152) 744 : cluster 0 pgmap v626: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:14.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:14 smithi103 bash[27315]: cluster 1689213133.185497 mgr.a (mgr.14152) 744 : cluster 0 pgmap v626: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:14.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:14 smithi084 bash[27323]: cluster 1689213133.185497 mgr.a (mgr.14152) 744 : cluster 0 pgmap v626: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:15.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:15 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Scheduled restart job, restart counter is at 3. 2023-07-13T01:52:15.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:15 smithi154 systemd[1]: Stopped Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:15.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:15 smithi154 systemd[1]: Started Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:16.095 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:15 smithi103 bash[27315]: cluster 1689213135.1861053 mgr.a (mgr.14152) 745 : cluster 0 pgmap v627: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:16.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:15 smithi084 bash[27323]: cluster 1689213135.1861053 mgr.a (mgr.14152) 745 : cluster 0 pgmap v627: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:16.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:15 smithi022 bash[26979]: cluster 1689213135.1861053 mgr.a (mgr.14152) 745 : cluster 0 pgmap v627: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:16.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:15 smithi154 bash[27744]: cluster 1689213135.1861053 mgr.a (mgr.14152) 745 : cluster 0 pgmap v627: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:16.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:15 smithi137 bash[27262]: cluster 1689213135.1861053 mgr.a (mgr.14152) 745 : cluster 0 pgmap v627: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:16.748 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:16 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:52:17.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:16 smithi154 bash[47544]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:17.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:16 smithi154 bash[47544]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:17.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:16 smithi154 bash[47544]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:17.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:16 smithi154 bash[47544]: --> Failed to activate any OSD(s) 2023-07-13T01:52:17.452 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:52:17.998 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:17 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 7. 2023-07-13T01:52:17.998 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:17 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:17.998 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:17 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:18.117 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:18.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:18 smithi022 bash[26979]: cluster 1689213137.1866503 mgr.a (mgr.14152) 746 : cluster 0 pgmap v628: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:18.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:18 smithi022 bash[26979]: audit 1689213137.4693599 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.22:0/915244952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:18.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:18 smithi154 bash[27744]: cluster 1689213137.1866503 mgr.a (mgr.14152) 746 : cluster 0 pgmap v628: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:18.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:18 smithi154 bash[27744]: audit 1689213137.4693599 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.22:0/915244952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:18.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:18 smithi137 bash[27262]: cluster 1689213137.1866503 mgr.a (mgr.14152) 746 : cluster 0 pgmap v628: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:18.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:18 smithi137 bash[27262]: audit 1689213137.4693599 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.22:0/915244952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:18.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:18 smithi103 bash[27315]: cluster 1689213137.1866503 mgr.a (mgr.14152) 746 : cluster 0 pgmap v628: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:18.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:18 smithi103 bash[27315]: audit 1689213137.4693599 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.22:0/915244952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:18.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:18 smithi084 bash[27323]: cluster 1689213137.1866503 mgr.a (mgr.14152) 746 : cluster 0 pgmap v628: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:18.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:18 smithi084 bash[27323]: audit 1689213137.4693599 mon.c (mon.2) 10 : audit 0 from='client.? 172.21.15.22:0/915244952' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:19.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:19.396 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:19 smithi154 bash[47676]: debug 2023-07-13T01:52:19.230+0000 7fc23fe39700 1 -- 172.21.15.154:0/4026870376 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556a518e8d00 con 0x556a5193f000 2023-07-13T01:52:19.397 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:19 smithi154 bash[47676]: debug 2023-07-13T01:52:19.230+0000 7fc248fbe640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:19.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:19 smithi154 bash[47712]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:19.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:19 smithi154 bash[47712]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:19.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:19 smithi154 bash[47712]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:19.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:19 smithi154 bash[47712]: --> Failed to activate any OSD(s) 2023-07-13T01:52:20.199 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:20 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:20.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:20 smithi154 bash[27744]: cluster 1689213139.1871738 mgr.a (mgr.14152) 747 : cluster 0 pgmap v629: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:20.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:20 smithi137 bash[27262]: cluster 1689213139.1871738 mgr.a (mgr.14152) 747 : cluster 0 pgmap v629: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:20.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:20 smithi103 bash[27315]: cluster 1689213139.1871738 mgr.a (mgr.14152) 747 : cluster 0 pgmap v629: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:20.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:20 smithi084 bash[27323]: cluster 1689213139.1871738 mgr.a (mgr.14152) 747 : cluster 0 pgmap v629: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:20.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:20 smithi022 bash[26979]: cluster 1689213139.1871738 mgr.a (mgr.14152) 747 : cluster 0 pgmap v629: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:22.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:22 smithi154 bash[47964]: debug 2023-07-13T01:52:22.138+0000 7f05ff114700 1 -- 172.21.15.154:0/194477518 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d7a7208d00 con 0x55d7a725e800 2023-07-13T01:52:22.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:22 smithi154 bash[47964]: debug 2023-07-13T01:52:22.142+0000 7f0608299640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:22.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:22 smithi154 bash[27744]: cluster 1689213141.1876853 mgr.a (mgr.14152) 748 : cluster 0 pgmap v630: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:22.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:22 smithi137 bash[27262]: cluster 1689213141.1876853 mgr.a (mgr.14152) 748 : cluster 0 pgmap v630: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:22.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:22 smithi103 bash[27315]: cluster 1689213141.1876853 mgr.a (mgr.14152) 748 : cluster 0 pgmap v630: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:22.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:22 smithi084 bash[27323]: cluster 1689213141.1876853 mgr.a (mgr.14152) 748 : cluster 0 pgmap v630: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:22 smithi022 bash[26979]: cluster 1689213141.1876853 mgr.a (mgr.14152) 748 : cluster 0 pgmap v630: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:23.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:23 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:23.499 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:23 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Failed with result 'exit-code'. 2023-07-13T01:52:23.816 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:52:24.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:24 smithi154 bash[27744]: cluster 1689213143.188174 mgr.a (mgr.14152) 749 : cluster 0 pgmap v631: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:24.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:24 smithi137 bash[27262]: cluster 1689213143.188174 mgr.a (mgr.14152) 749 : cluster 0 pgmap v631: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:24.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:24 smithi103 bash[27315]: cluster 1689213143.188174 mgr.a (mgr.14152) 749 : cluster 0 pgmap v631: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:24.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:24 smithi084 bash[27323]: cluster 1689213143.188174 mgr.a (mgr.14152) 749 : cluster 0 pgmap v631: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:24 smithi022 bash[26979]: cluster 1689213143.188174 mgr.a (mgr.14152) 749 : cluster 0 pgmap v631: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:25.748 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:25 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:52:25.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:25 smithi022 bash[26979]: cluster 1689213145.1887038 mgr.a (mgr.14152) 750 : cluster 0 pgmap v632: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:26.095 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:25 smithi103 bash[27315]: cluster 1689213145.1887038 mgr.a (mgr.14152) 750 : cluster 0 pgmap v632: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:26.136 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:25 smithi084 bash[27323]: cluster 1689213145.1887038 mgr.a (mgr.14152) 750 : cluster 0 pgmap v632: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:26.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:25 smithi154 bash[27744]: cluster 1689213145.1887038 mgr.a (mgr.14152) 750 : cluster 0 pgmap v632: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:26.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:25 smithi137 bash[27262]: cluster 1689213145.1887038 mgr.a (mgr.14152) 750 : cluster 0 pgmap v632: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:26.998 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:26 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 11. 2023-07-13T01:52:26.998 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:26 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:26.998 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:26 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:27.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:52:27.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:27 smithi103 bash[27315]: audit 1689213147.039707 mon.b (mon.4) 20 : audit 0 from='client.? 172.21.15.22:0/3329898512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:27.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:27 smithi084 bash[27323]: audit 1689213147.039707 mon.b (mon.4) 20 : audit 0 from='client.? 172.21.15.22:0/3329898512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:27.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:27 smithi022 bash[26979]: audit 1689213147.039707 mon.b (mon.4) 20 : audit 0 from='client.? 172.21.15.22:0/3329898512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:27.438 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:27 smithi154 bash[27744]: audit 1689213147.039707 mon.b (mon.4) 20 : audit 0 from='client.? 172.21.15.22:0/3329898512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:27.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:27 smithi137 bash[27262]: audit 1689213147.039707 mon.b (mon.4) 20 : audit 0 from='client.? 172.21.15.22:0/3329898512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:27.701 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:28.078 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:27 smithi154 bash[48295]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:28.079 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:27 smithi154 bash[48295]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:28.079 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:27 smithi154 bash[48295]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:28.079 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:27 smithi154 bash[48295]: --> Failed to activate any OSD(s) 2023-07-13T01:52:28.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:28 smithi103 bash[27315]: cluster 1689213147.1892526 mgr.a (mgr.14152) 751 : cluster 0 pgmap v633: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:28.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:28 smithi084 bash[27323]: cluster 1689213147.1892526 mgr.a (mgr.14152) 751 : cluster 0 pgmap v633: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:28.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:28 smithi022 bash[26979]: cluster 1689213147.1892526 mgr.a (mgr.14152) 751 : cluster 0 pgmap v633: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:28.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:28 smithi154 bash[27744]: cluster 1689213147.1892526 mgr.a (mgr.14152) 751 : cluster 0 pgmap v633: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:28.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:28 smithi137 bash[27262]: cluster 1689213147.1892526 mgr.a (mgr.14152) 751 : cluster 0 pgmap v633: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:28.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:29.704 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:29 smithi154 bash[48397]: debug 2023-07-13T01:52:29.554+0000 7f8d5bd65700 1 -- 172.21.15.154:0/3604083373 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563463792d00 con 0x5634637e9000 2023-07-13T01:52:29.704 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:29 smithi154 bash[48397]: debug 2023-07-13T01:52:29.554+0000 7f8d64eea640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:30.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:30 smithi154 bash[27744]: cluster 1689213149.1898098 mgr.a (mgr.14152) 752 : cluster 0 pgmap v634: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:30.498 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:30 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:30.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:30 smithi137 bash[27262]: cluster 1689213149.1898098 mgr.a (mgr.14152) 752 : cluster 0 pgmap v634: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:30.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:30 smithi103 bash[27315]: cluster 1689213149.1898098 mgr.a (mgr.14152) 752 : cluster 0 pgmap v634: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:30.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:30 smithi084 bash[27323]: cluster 1689213149.1898098 mgr.a (mgr.14152) 752 : cluster 0 pgmap v634: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:30.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:30 smithi022 bash[26979]: cluster 1689213149.1898098 mgr.a (mgr.14152) 752 : cluster 0 pgmap v634: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:32.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:32 smithi154 bash[27744]: cluster 1689213151.1903963 mgr.a (mgr.14152) 753 : cluster 0 pgmap v635: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:32.498 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:32 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:52:32.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:32 smithi137 bash[27262]: cluster 1689213151.1903963 mgr.a (mgr.14152) 753 : cluster 0 pgmap v635: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:32.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:32 smithi103 bash[27315]: cluster 1689213151.1903963 mgr.a (mgr.14152) 753 : cluster 0 pgmap v635: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:32.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:32 smithi084 bash[27323]: cluster 1689213151.1903963 mgr.a (mgr.14152) 753 : cluster 0 pgmap v635: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:32.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:32 smithi022 bash[26979]: cluster 1689213151.1903963 mgr.a (mgr.14152) 753 : cluster 0 pgmap v635: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:33.403 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:52:33.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:33 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Scheduled restart job, restart counter is at 4. 2023-07-13T01:52:33.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:33 smithi154 systemd[1]: Stopped Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:33.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:33 smithi154 systemd[1]: Started Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:34.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:34 smithi154 bash[27744]: cluster 1689213153.1910744 mgr.a (mgr.14152) 754 : cluster 0 pgmap v636: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:34.537 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:34 smithi022 bash[26979]: cluster 1689213153.1910744 mgr.a (mgr.14152) 754 : cluster 0 pgmap v636: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:34.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:34 smithi137 bash[27262]: cluster 1689213153.1910744 mgr.a (mgr.14152) 754 : cluster 0 pgmap v636: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:34.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:34 smithi103 bash[27315]: cluster 1689213153.1910744 mgr.a (mgr.14152) 754 : cluster 0 pgmap v636: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:34.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:34 smithi084 bash[27323]: cluster 1689213153.1910744 mgr.a (mgr.14152) 754 : cluster 0 pgmap v636: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:35.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:34 smithi154 bash[48654]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:35.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:34 smithi154 bash[48654]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:35.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:34 smithi154 bash[48654]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:35.248 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:34 smithi154 bash[48654]: --> Failed to activate any OSD(s) 2023-07-13T01:52:35.850 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:35 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 8. 2023-07-13T01:52:35.851 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:35 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:35.851 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:35 smithi154 systemd[1]: Started Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:36.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:35 smithi084 bash[27323]: cluster 1689213155.1916275 mgr.a (mgr.14152) 755 : cluster 0 pgmap v637: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:36.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:35 smithi022 bash[26979]: cluster 1689213155.1916275 mgr.a (mgr.14152) 755 : cluster 0 pgmap v637: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:36.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:35 smithi154 bash[27744]: cluster 1689213155.1916275 mgr.a (mgr.14152) 755 : cluster 0 pgmap v637: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:36.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:35 smithi137 bash[27262]: cluster 1689213155.1916275 mgr.a (mgr.14152) 755 : cluster 0 pgmap v637: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:36.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:35 smithi103 bash[27315]: cluster 1689213155.1916275 mgr.a (mgr.14152) 755 : cluster 0 pgmap v637: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:36.561 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:52:36.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:36 smithi022 bash[26979]: audit 1689213156.578322 mon.d (mon.3) 9 : audit 0 from='client.? 172.21.15.22:0/3076753862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:37.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:36 smithi084 bash[27323]: audit 1689213156.578322 mon.d (mon.3) 9 : audit 0 from='client.? 172.21.15.22:0/3076753862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:37.149 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:36 smithi154 bash[27744]: audit 1689213156.578322 mon.d (mon.3) 9 : audit 0 from='client.? 172.21.15.22:0/3076753862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:37.149 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[48757]: debug 2023-07-13T01:52:37.070+0000 7f6dbb8f3700 1 -- 172.21.15.154:0/2688004479 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5593bc0b8d00 con 0x5593bc10ec00 2023-07-13T01:52:37.150 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[48757]: debug 2023-07-13T01:52:37.070+0000 7f6dc4a78640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:37.291 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:37.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:36 smithi137 bash[27262]: audit 1689213156.578322 mon.d (mon.3) 9 : audit 0 from='client.? 172.21.15.22:0/3076753862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:37.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:36 smithi103 bash[27315]: audit 1689213156.578322 mon.d (mon.3) 9 : audit 0 from='client.? 172.21.15.22:0/3076753862' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:37.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[48790]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:37.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[48790]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:37.498 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[48790]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:37.499 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[48790]: --> Failed to activate any OSD(s) 2023-07-13T01:52:38.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:37 smithi084 bash[27323]: cluster 1689213157.1921723 mgr.a (mgr.14152) 756 : cluster 0 pgmap v638: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:38.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:37 smithi022 bash[26979]: cluster 1689213157.1921723 mgr.a (mgr.14152) 756 : cluster 0 pgmap v638: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:38.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:37 smithi154 bash[27744]: cluster 1689213157.1921723 mgr.a (mgr.14152) 756 : cluster 0 pgmap v638: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:38.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:38.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:37 smithi137 bash[27262]: cluster 1689213157.1921723 mgr.a (mgr.14152) 756 : cluster 0 pgmap v638: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:38.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:37 smithi103 bash[27315]: cluster 1689213157.1921723 mgr.a (mgr.14152) 756 : cluster 0 pgmap v638: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:38.748 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:38 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:39.998 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:39 smithi154 bash[49044]: debug 2023-07-13T01:52:39.870+0000 7f4e97c75700 1 -- 172.21.15.154:0/3632358682 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5590416f0d00 con 0x559041746800 2023-07-13T01:52:39.998 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:39 smithi154 bash[49044]: debug 2023-07-13T01:52:39.870+0000 7f4ea0dfa640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:40.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:40 smithi154 bash[27744]: cluster 1689213159.1926787 mgr.a (mgr.14152) 757 : cluster 0 pgmap v639: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:40.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:40 smithi137 bash[27262]: cluster 1689213159.1926787 mgr.a (mgr.14152) 757 : cluster 0 pgmap v639: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:40.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:40 smithi103 bash[27315]: cluster 1689213159.1926787 mgr.a (mgr.14152) 757 : cluster 0 pgmap v639: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:40.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:40 smithi084 bash[27323]: cluster 1689213159.1926787 mgr.a (mgr.14152) 757 : cluster 0 pgmap v639: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:40.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:40 smithi022 bash[26979]: cluster 1689213159.1926787 mgr.a (mgr.14152) 757 : cluster 0 pgmap v639: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:41.248 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:40 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:41.747 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:41 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Failed with result 'exit-code'. 2023-07-13T01:52:42.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:42 smithi154 bash[27744]: cluster 1689213161.1932175 mgr.a (mgr.14152) 758 : cluster 0 pgmap v640: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:42.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:42 smithi137 bash[27262]: cluster 1689213161.1932175 mgr.a (mgr.14152) 758 : cluster 0 pgmap v640: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:42.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:42 smithi103 bash[27315]: cluster 1689213161.1932175 mgr.a (mgr.14152) 758 : cluster 0 pgmap v640: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:42.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:42 smithi084 bash[27323]: cluster 1689213161.1932175 mgr.a (mgr.14152) 758 : cluster 0 pgmap v640: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:42.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:42 smithi022 bash[26979]: cluster 1689213161.1932175 mgr.a (mgr.14152) 758 : cluster 0 pgmap v640: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:42.942 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:42 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 12. 2023-07-13T01:52:42.943 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:42 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:42.943 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:42 smithi154 systemd[1]: Started Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:42.993 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:52:43.888 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:43 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:52:44.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:44 smithi154 bash[27744]: cluster 1689213163.193742 mgr.a (mgr.14152) 759 : cluster 0 pgmap v641: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:44.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:44 smithi154 bash[27744]: audit 1689213163.349984 mon.a (mon.0) 1056 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:52:44.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:44 smithi154 bash[49374]: --> Failed to activate via raw: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:44.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:44 smithi154 bash[49374]: --> Failed to activate via LVM: 'Activate' object has no attribute 'activate' 2023-07-13T01:52:44.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:44 smithi154 bash[49374]: --> Failed to activate via simple: 'Namespace' object has no attribute 'json_config' 2023-07-13T01:52:44.499 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:44 smithi154 bash[49374]: --> Failed to activate any OSD(s) 2023-07-13T01:52:44.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:44 smithi137 bash[27262]: cluster 1689213163.193742 mgr.a (mgr.14152) 759 : cluster 0 pgmap v641: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:44.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:44 smithi137 bash[27262]: audit 1689213163.349984 mon.a (mon.0) 1056 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:52:44.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:44 smithi103 bash[27315]: cluster 1689213163.193742 mgr.a (mgr.14152) 759 : cluster 0 pgmap v641: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:44.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:44 smithi103 bash[27315]: audit 1689213163.349984 mon.a (mon.0) 1056 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:52:44.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:44 smithi084 bash[27323]: cluster 1689213163.193742 mgr.a (mgr.14152) 759 : cluster 0 pgmap v641: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:44.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:44 smithi084 bash[27323]: audit 1689213163.349984 mon.a (mon.0) 1056 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:52:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:44 smithi022 bash[26979]: cluster 1689213163.193742 mgr.a (mgr.14152) 759 : cluster 0 pgmap v641: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:44.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:44 smithi022 bash[26979]: audit 1689213163.349984 mon.a (mon.0) 1056 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:52:46.101 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:45 smithi154 bash[27744]: cluster 1689213165.1942384 mgr.a (mgr.14152) 760 : cluster 0 pgmap v642: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:46.101 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:45 smithi154 bash[49491]: debug 2023-07-13T01:52:45.934+0000 7fccc8db8700 1 -- 172.21.15.154:0/1506708358 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ce2598ed00 con 0x55ce259e5000 2023-07-13T01:52:46.102 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:45 smithi154 bash[49491]: debug 2023-07-13T01:52:45.938+0000 7fccd1f3d640 -1 missing 'type' file and unable to infer osd type 2023-07-13T01:52:46.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:45 smithi084 bash[27323]: cluster 1689213165.1942384 mgr.a (mgr.14152) 760 : cluster 0 pgmap v642: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:46.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:45 smithi022 bash[26979]: cluster 1689213165.1942384 mgr.a (mgr.14152) 760 : cluster 0 pgmap v642: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:52:46.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:45 smithi137 bash[27262]: cluster 1689213165.1942384 mgr.a (mgr.14152) 760 : cluster 0 pgmap v642: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:46.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:45 smithi103 bash[27315]: cluster 1689213165.1942384 mgr.a (mgr.14152) 760 : cluster 0 pgmap v642: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:46.855 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:46.860 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:46 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Main process exited, code=exited, status=1/FAILURE 2023-07-13T01:52:47.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:46 smithi084 bash[27323]: audit 1689213166.186319 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.22:0/3930173081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:47.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:46 smithi022 bash[26979]: audit 1689213166.186319 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.22:0/3930173081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:47.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:46 smithi154 bash[27744]: audit 1689213166.186319 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.22:0/3930173081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:47.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:46 smithi137 bash[27262]: audit 1689213166.186319 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.22:0/3930173081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:47.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:46 smithi103 bash[27315]: audit 1689213166.186319 mon.c (mon.2) 11 : audit 0 from='client.? 172.21.15.22:0/3930173081' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:47.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:48.122 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:47 smithi154 bash[27744]: cluster 1689213167.1947625 mgr.a (mgr.14152) 761 : cluster 0 pgmap v643: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:48.135 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:47 smithi084 bash[27323]: cluster 1689213167.1947625 mgr.a (mgr.14152) 761 : cluster 0 pgmap v643: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:48.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:47 smithi022 bash[26979]: cluster 1689213167.1947625 mgr.a (mgr.14152) 761 : cluster 0 pgmap v643: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:48.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:47 smithi137 bash[27262]: cluster 1689213167.1947625 mgr.a (mgr.14152) 761 : cluster 0 pgmap v643: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:48.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:47 smithi103 bash[27315]: cluster 1689213167.1947625 mgr.a (mgr.14152) 761 : cluster 0 pgmap v643: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:48.997 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:48 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:52:50.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213168.922165 mon.a (mon.0) 1057 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213168.9298997 mon.a (mon.0) 1058 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: cluster 1689213169.1952655 mgr.a (mgr.14152) 762 : cluster 0 pgmap v644: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:50.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213169.40265 mon.a (mon.0) 1059 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213169.4042559 mon.a (mon.0) 1060 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213169.4057868 mon.a (mon.0) 1061 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213169.409048 mon.a (mon.0) 1062 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:52:50.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213169.4104538 mon.a (mon.0) 1063 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:52:50.249 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:49 smithi154 bash[27744]: audit 1689213169.4209688 mon.a (mon.0) 1064 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213168.922165 mon.a (mon.0) 1057 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213168.9298997 mon.a (mon.0) 1058 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: cluster 1689213169.1952655 mgr.a (mgr.14152) 762 : cluster 0 pgmap v644: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:50.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213169.40265 mon.a (mon.0) 1059 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213169.4042559 mon.a (mon.0) 1060 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213169.4057868 mon.a (mon.0) 1061 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213169.409048 mon.a (mon.0) 1062 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:52:50.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213169.4104538 mon.a (mon.0) 1063 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:52:50.296 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:49 smithi137 bash[27262]: audit 1689213169.4209688 mon.a (mon.0) 1064 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213168.922165 mon.a (mon.0) 1057 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213168.9298997 mon.a (mon.0) 1058 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: cluster 1689213169.1952655 mgr.a (mgr.14152) 762 : cluster 0 pgmap v644: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:50.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213169.40265 mon.a (mon.0) 1059 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213169.4042559 mon.a (mon.0) 1060 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213169.4057868 mon.a (mon.0) 1061 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213169.409048 mon.a (mon.0) 1062 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:52:50.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213169.4104538 mon.a (mon.0) 1063 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:52:50.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:49 smithi103 bash[27315]: audit 1689213169.4209688 mon.a (mon.0) 1064 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213168.922165 mon.a (mon.0) 1057 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213168.9298997 mon.a (mon.0) 1058 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: cluster 1689213169.1952655 mgr.a (mgr.14152) 762 : cluster 0 pgmap v644: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:50.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213169.40265 mon.a (mon.0) 1059 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213169.4042559 mon.a (mon.0) 1060 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213169.4057868 mon.a (mon.0) 1061 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213169.409048 mon.a (mon.0) 1062 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:52:50.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213169.4104538 mon.a (mon.0) 1063 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:52:50.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:49 smithi084 bash[27323]: audit 1689213169.4209688 mon.a (mon.0) 1064 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213168.922165 mon.a (mon.0) 1057 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213168.9298997 mon.a (mon.0) 1058 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: cluster 1689213169.1952655 mgr.a (mgr.14152) 762 : cluster 0 pgmap v644: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213169.40265 mon.a (mon.0) 1059 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213169.4042559 mon.a (mon.0) 1060 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213169.4057868 mon.a (mon.0) 1061 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:52:50.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213169.409048 mon.a (mon.0) 1062 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:52:50.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213169.4104538 mon.a (mon.0) 1063 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:52:50.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:49 smithi022 bash[26979]: audit 1689213169.4209688 mon.a (mon.0) 1064 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:52:51.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:50 smithi154 bash[27744]: cephadm 1689213169.406969 mgr.a (mgr.14152) 763 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:52:51.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:50 smithi154 bash[27744]: cluster 1689213169.4131296 mgr.a (mgr.14152) 764 : cluster 0 pgmap v645: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:50 smithi154 bash[27744]: cluster 1689213169.4133909 mgr.a (mgr.14152) 765 : cluster 0 pgmap v646: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:50 smithi137 bash[27262]: cephadm 1689213169.406969 mgr.a (mgr.14152) 763 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:52:51.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:50 smithi137 bash[27262]: cluster 1689213169.4131296 mgr.a (mgr.14152) 764 : cluster 0 pgmap v645: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:50 smithi137 bash[27262]: cluster 1689213169.4133909 mgr.a (mgr.14152) 765 : cluster 0 pgmap v646: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:50 smithi103 bash[27315]: cephadm 1689213169.406969 mgr.a (mgr.14152) 763 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:52:51.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:50 smithi103 bash[27315]: cluster 1689213169.4131296 mgr.a (mgr.14152) 764 : cluster 0 pgmap v645: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.346 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:50 smithi103 bash[27315]: cluster 1689213169.4133909 mgr.a (mgr.14152) 765 : cluster 0 pgmap v646: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:50 smithi084 bash[27323]: cephadm 1689213169.406969 mgr.a (mgr.14152) 763 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:52:51.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:50 smithi084 bash[27323]: cluster 1689213169.4131296 mgr.a (mgr.14152) 764 : cluster 0 pgmap v645: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:50 smithi084 bash[27323]: cluster 1689213169.4133909 mgr.a (mgr.14152) 765 : cluster 0 pgmap v646: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:50 smithi022 bash[26979]: cephadm 1689213169.406969 mgr.a (mgr.14152) 763 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T01:52:51.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:50 smithi022 bash[26979]: cluster 1689213169.4131296 mgr.a (mgr.14152) 764 : cluster 0 pgmap v645: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:50 smithi022 bash[26979]: cluster 1689213169.4133909 mgr.a (mgr.14152) 765 : cluster 0 pgmap v646: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:51.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:51 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Scheduled restart job, restart counter is at 5. 2023-07-13T01:52:51.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:51 smithi154 systemd[1]: Stopped Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:51.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:51 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Start request repeated too quickly. 2023-07-13T01:52:51.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:51 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service: Failed with result 'exit-code'. 2023-07-13T01:52:51.998 INFO:journalctl@ceph.osd.14.smithi154.stdout:Jul 13 01:52:51 smithi154 systemd[1]: Failed to start Ceph osd.14 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:52.547 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:52:53.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:52 smithi154 bash[27744]: cluster 1689213171.4138768 mgr.a (mgr.14152) 766 : cluster 0 pgmap v647: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:53.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:52 smithi137 bash[27262]: cluster 1689213171.4138768 mgr.a (mgr.14152) 766 : cluster 0 pgmap v647: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:53.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:52 smithi103 bash[27315]: cluster 1689213171.4138768 mgr.a (mgr.14152) 766 : cluster 0 pgmap v647: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:53.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:52 smithi084 bash[27323]: cluster 1689213171.4138768 mgr.a (mgr.14152) 766 : cluster 0 pgmap v647: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:52 smithi022 bash[26979]: cluster 1689213171.4138768 mgr.a (mgr.14152) 766 : cluster 0 pgmap v647: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:54.248 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:53 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Scheduled restart job, restart counter is at 9. 2023-07-13T01:52:54.248 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:53 smithi154 systemd[1]: Stopped Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:54.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:53 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Start request repeated too quickly. 2023-07-13T01:52:54.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:53 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service: Failed with result 'exit-code'. 2023-07-13T01:52:54.249 INFO:journalctl@ceph.osd.13.smithi154.stdout:Jul 13 01:52:53 smithi154 systemd[1]: Failed to start Ceph osd.13 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:55.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:54 smithi154 bash[27744]: cluster 1689213173.414401 mgr.a (mgr.14152) 767 : cluster 0 pgmap v648: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:55.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:54 smithi137 bash[27262]: cluster 1689213173.414401 mgr.a (mgr.14152) 767 : cluster 0 pgmap v648: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:55.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:54 smithi103 bash[27315]: cluster 1689213173.414401 mgr.a (mgr.14152) 767 : cluster 0 pgmap v648: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:55.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:54 smithi084 bash[27323]: cluster 1689213173.414401 mgr.a (mgr.14152) 767 : cluster 0 pgmap v648: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:55.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:54 smithi022 bash[26979]: cluster 1689213173.414401 mgr.a (mgr.14152) 767 : cluster 0 pgmap v648: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:55.869 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:52:56.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:55 smithi154 bash[27744]: audit 1689213175.8818173 mon.a (mon.0) 1065 : audit 0 from='client.? 172.21.15.22:0/890018552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:56.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:55 smithi137 bash[27262]: audit 1689213175.8818173 mon.a (mon.0) 1065 : audit 0 from='client.? 172.21.15.22:0/890018552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:56.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:55 smithi103 bash[27315]: audit 1689213175.8818173 mon.a (mon.0) 1065 : audit 0 from='client.? 172.21.15.22:0/890018552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:56.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:55 smithi084 bash[27323]: audit 1689213175.8818173 mon.a (mon.0) 1065 : audit 0 from='client.? 172.21.15.22:0/890018552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:55 smithi022 bash[26979]: audit 1689213175.8818173 mon.a (mon.0) 1065 : audit 0 from='client.? 172.21.15.22:0/890018552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:52:56.553 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:52:57.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:56 smithi154 bash[27744]: cluster 1689213175.4148219 mgr.a (mgr.14152) 768 : cluster 0 pgmap v649: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:57.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:56 smithi137 bash[27262]: cluster 1689213175.4148219 mgr.a (mgr.14152) 768 : cluster 0 pgmap v649: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:57.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:56 smithi103 bash[27315]: cluster 1689213175.4148219 mgr.a (mgr.14152) 768 : cluster 0 pgmap v649: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:57.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:56 smithi084 bash[27323]: cluster 1689213175.4148219 mgr.a (mgr.14152) 768 : cluster 0 pgmap v649: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:57.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:56 smithi022 bash[26979]: cluster 1689213175.4148219 mgr.a (mgr.14152) 768 : cluster 0 pgmap v649: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:57.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:52:59.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:52:58 smithi154 bash[27744]: cluster 1689213177.4153943 mgr.a (mgr.14152) 769 : cluster 0 pgmap v650: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:59.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:58 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Scheduled restart job, restart counter is at 13. 2023-07-13T01:52:59.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:58 smithi154 systemd[1]: Stopped Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:59.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:58 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Start request repeated too quickly. 2023-07-13T01:52:59.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:58 smithi154 systemd[1]: ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service: Failed with result 'exit-code'. 2023-07-13T01:52:59.249 INFO:journalctl@ceph.osd.12.smithi154.stdout:Jul 13 01:52:58 smithi154 systemd[1]: Failed to start Ceph osd.12 for f81712b0-211c-11ee-9b31-001a4aab830c. 2023-07-13T01:52:59.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:52:58 smithi137 bash[27262]: cluster 1689213177.4153943 mgr.a (mgr.14152) 769 : cluster 0 pgmap v650: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:59.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:52:58 smithi103 bash[27315]: cluster 1689213177.4153943 mgr.a (mgr.14152) 769 : cluster 0 pgmap v650: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:59.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:52:58 smithi022 bash[26979]: cluster 1689213177.4153943 mgr.a (mgr.14152) 769 : cluster 0 pgmap v650: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:52:59.418 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:52:58 smithi084 bash[27323]: cluster 1689213177.4153943 mgr.a (mgr.14152) 769 : cluster 0 pgmap v650: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:01.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:00 smithi154 bash[27744]: cluster 1689213179.4160123 mgr.a (mgr.14152) 770 : cluster 0 pgmap v651: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:01.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:00 smithi137 bash[27262]: cluster 1689213179.4160123 mgr.a (mgr.14152) 770 : cluster 0 pgmap v651: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:01.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:00 smithi103 bash[27315]: cluster 1689213179.4160123 mgr.a (mgr.14152) 770 : cluster 0 pgmap v651: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:01.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:00 smithi084 bash[27323]: cluster 1689213179.4160123 mgr.a (mgr.14152) 770 : cluster 0 pgmap v651: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:01.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:00 smithi022 bash[26979]: cluster 1689213179.4160123 mgr.a (mgr.14152) 770 : cluster 0 pgmap v651: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:02.245 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:53:03.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:02 smithi022 bash[26979]: cluster 1689213181.4165294 mgr.a (mgr.14152) 771 : cluster 0 pgmap v652: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:03.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:02 smithi154 bash[27744]: cluster 1689213181.4165294 mgr.a (mgr.14152) 771 : cluster 0 pgmap v652: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:03.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:02 smithi137 bash[27262]: cluster 1689213181.4165294 mgr.a (mgr.14152) 771 : cluster 0 pgmap v652: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:03.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:02 smithi103 bash[27315]: cluster 1689213181.4165294 mgr.a (mgr.14152) 771 : cluster 0 pgmap v652: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:03.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:02 smithi084 bash[27323]: cluster 1689213181.4165294 mgr.a (mgr.14152) 771 : cluster 0 pgmap v652: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:05.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:04 smithi154 bash[27744]: cluster 1689213183.416856 mgr.a (mgr.14152) 772 : cluster 0 pgmap v653: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:05.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:04 smithi137 bash[27262]: cluster 1689213183.416856 mgr.a (mgr.14152) 772 : cluster 0 pgmap v653: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:05.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:04 smithi103 bash[27315]: cluster 1689213183.416856 mgr.a (mgr.14152) 772 : cluster 0 pgmap v653: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:05.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:04 smithi084 bash[27323]: cluster 1689213183.416856 mgr.a (mgr.14152) 772 : cluster 0 pgmap v653: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:05.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:04 smithi022 bash[26979]: cluster 1689213183.416856 mgr.a (mgr.14152) 772 : cluster 0 pgmap v653: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:05.503 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:53:06.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:05 smithi022 bash[26979]: audit 1689213185.516446 mon.a (mon.0) 1066 : audit 0 from='client.? 172.21.15.22:0/3415116499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:06.248 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:53:06.248 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:05 smithi154 bash[27744]: audit 1689213185.516446 mon.a (mon.0) 1066 : audit 0 from='client.? 172.21.15.22:0/3415116499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:06.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:05 smithi137 bash[27262]: audit 1689213185.516446 mon.a (mon.0) 1066 : audit 0 from='client.? 172.21.15.22:0/3415116499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:06.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:05 smithi103 bash[27315]: audit 1689213185.516446 mon.a (mon.0) 1066 : audit 0 from='client.? 172.21.15.22:0/3415116499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:06.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:05 smithi084 bash[27323]: audit 1689213185.516446 mon.a (mon.0) 1066 : audit 0 from='client.? 172.21.15.22:0/3415116499' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:07.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:06 smithi154 bash[27744]: cluster 1689213185.4172976 mgr.a (mgr.14152) 773 : cluster 0 pgmap v654: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:07.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:53:07.263 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:06 smithi022 bash[26979]: cluster 1689213185.4172976 mgr.a (mgr.14152) 773 : cluster 0 pgmap v654: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:07.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:06 smithi137 bash[27262]: cluster 1689213185.4172976 mgr.a (mgr.14152) 773 : cluster 0 pgmap v654: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:07.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:06 smithi103 bash[27315]: cluster 1689213185.4172976 mgr.a (mgr.14152) 773 : cluster 0 pgmap v654: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:07.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:06 smithi084 bash[27323]: cluster 1689213185.4172976 mgr.a (mgr.14152) 773 : cluster 0 pgmap v654: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:09.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:08 smithi154 bash[27744]: cluster 1689213187.417682 mgr.a (mgr.14152) 774 : cluster 0 pgmap v655: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:09.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:08 smithi137 bash[27262]: cluster 1689213187.417682 mgr.a (mgr.14152) 774 : cluster 0 pgmap v655: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:09.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:08 smithi103 bash[27315]: cluster 1689213187.417682 mgr.a (mgr.14152) 774 : cluster 0 pgmap v655: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:09.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:08 smithi084 bash[27323]: cluster 1689213187.417682 mgr.a (mgr.14152) 774 : cluster 0 pgmap v655: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:09.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:08 smithi022 bash[26979]: cluster 1689213187.417682 mgr.a (mgr.14152) 774 : cluster 0 pgmap v655: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:11.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:10 smithi154 bash[27744]: cluster 1689213189.4181669 mgr.a (mgr.14152) 775 : cluster 0 pgmap v656: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:11.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:10 smithi137 bash[27262]: cluster 1689213189.4181669 mgr.a (mgr.14152) 775 : cluster 0 pgmap v656: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:11.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:10 smithi103 bash[27315]: cluster 1689213189.4181669 mgr.a (mgr.14152) 775 : cluster 0 pgmap v656: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:11.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:10 smithi084 bash[27323]: cluster 1689213189.4181669 mgr.a (mgr.14152) 775 : cluster 0 pgmap v656: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:11.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:10 smithi022 bash[26979]: cluster 1689213189.4181669 mgr.a (mgr.14152) 775 : cluster 0 pgmap v656: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:11.942 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:53:13.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:12 smithi022 bash[26979]: cluster 1689213191.4186552 mgr.a (mgr.14152) 776 : cluster 0 pgmap v657: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:13.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:12 smithi154 bash[27744]: cluster 1689213191.4186552 mgr.a (mgr.14152) 776 : cluster 0 pgmap v657: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:13.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:12 smithi137 bash[27262]: cluster 1689213191.4186552 mgr.a (mgr.14152) 776 : cluster 0 pgmap v657: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:13.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:12 smithi103 bash[27315]: cluster 1689213191.4186552 mgr.a (mgr.14152) 776 : cluster 0 pgmap v657: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:13.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:12 smithi084 bash[27323]: cluster 1689213191.4186552 mgr.a (mgr.14152) 776 : cluster 0 pgmap v657: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:15.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:14 smithi022 bash[26979]: cluster 1689213193.4192338 mgr.a (mgr.14152) 777 : cluster 0 pgmap v658: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:15.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:15 smithi154 bash[27744]: cluster 1689213193.4192338 mgr.a (mgr.14152) 777 : cluster 0 pgmap v658: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:15.250 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:53:15.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:15 smithi137 bash[27262]: cluster 1689213193.4192338 mgr.a (mgr.14152) 777 : cluster 0 pgmap v658: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:15.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:15 smithi103 bash[27315]: cluster 1689213193.4192338 mgr.a (mgr.14152) 777 : cluster 0 pgmap v658: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:15.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:14 smithi084 bash[27323]: cluster 1689213193.4192338 mgr.a (mgr.14152) 777 : cluster 0 pgmap v658: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:15.953 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:53:16.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:16 smithi154 bash[27744]: audit 1689213195.2639854 mon.a (mon.0) 1067 : audit 0 from='client.? 172.21.15.22:0/202216101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:16.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:16 smithi137 bash[27262]: audit 1689213195.2639854 mon.a (mon.0) 1067 : audit 0 from='client.? 172.21.15.22:0/202216101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:16.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:16 smithi103 bash[27315]: audit 1689213195.2639854 mon.a (mon.0) 1067 : audit 0 from='client.? 172.21.15.22:0/202216101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:16.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:16 smithi084 bash[27323]: audit 1689213195.2639854 mon.a (mon.0) 1067 : audit 0 from='client.? 172.21.15.22:0/202216101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:16.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:16 smithi022 bash[26979]: audit 1689213195.2639854 mon.a (mon.0) 1067 : audit 0 from='client.? 172.21.15.22:0/202216101' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:16.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:53:17.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:17 smithi154 bash[27744]: cluster 1689213195.4196303 mgr.a (mgr.14152) 778 : cluster 0 pgmap v659: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:17.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:17 smithi137 bash[27262]: cluster 1689213195.4196303 mgr.a (mgr.14152) 778 : cluster 0 pgmap v659: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:17.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:17 smithi103 bash[27315]: cluster 1689213195.4196303 mgr.a (mgr.14152) 778 : cluster 0 pgmap v659: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:17.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:17 smithi084 bash[27323]: cluster 1689213195.4196303 mgr.a (mgr.14152) 778 : cluster 0 pgmap v659: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:17.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:17 smithi022 bash[26979]: cluster 1689213195.4196303 mgr.a (mgr.14152) 778 : cluster 0 pgmap v659: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:19.295 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:19 smithi137 bash[27262]: cluster 1689213197.4201047 mgr.a (mgr.14152) 779 : cluster 0 pgmap v660: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:19.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:19 smithi103 bash[27315]: cluster 1689213197.4201047 mgr.a (mgr.14152) 779 : cluster 0 pgmap v660: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:19.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:19 smithi084 bash[27323]: cluster 1689213197.4201047 mgr.a (mgr.14152) 779 : cluster 0 pgmap v660: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:19.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:19 smithi022 bash[26979]: cluster 1689213197.4201047 mgr.a (mgr.14152) 779 : cluster 0 pgmap v660: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:19.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:19 smithi154 bash[27744]: cluster 1689213197.4201047 mgr.a (mgr.14152) 779 : cluster 0 pgmap v660: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:21.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:21 smithi137 bash[27262]: cluster 1689213199.4206717 mgr.a (mgr.14152) 780 : cluster 0 pgmap v661: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:21.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:21 smithi103 bash[27315]: cluster 1689213199.4206717 mgr.a (mgr.14152) 780 : cluster 0 pgmap v661: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:21.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:21 smithi084 bash[27323]: cluster 1689213199.4206717 mgr.a (mgr.14152) 780 : cluster 0 pgmap v661: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:21.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:21 smithi022 bash[26979]: cluster 1689213199.4206717 mgr.a (mgr.14152) 780 : cluster 0 pgmap v661: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:21.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:21 smithi154 bash[27744]: cluster 1689213199.4206717 mgr.a (mgr.14152) 780 : cluster 0 pgmap v661: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:21.655 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:53:23.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:23 smithi137 bash[27262]: cluster 1689213201.4211934 mgr.a (mgr.14152) 781 : cluster 0 pgmap v662: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:23.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:23 smithi103 bash[27315]: cluster 1689213201.4211934 mgr.a (mgr.14152) 781 : cluster 0 pgmap v662: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:23.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:23 smithi084 bash[27323]: cluster 1689213201.4211934 mgr.a (mgr.14152) 781 : cluster 0 pgmap v662: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:23.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:23 smithi022 bash[26979]: cluster 1689213201.4211934 mgr.a (mgr.14152) 781 : cluster 0 pgmap v662: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:23.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:23 smithi154 bash[27744]: cluster 1689213201.4211934 mgr.a (mgr.14152) 781 : cluster 0 pgmap v662: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:24.954 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:53:25.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:25 smithi137 bash[27262]: cluster 1689213203.4217114 mgr.a (mgr.14152) 782 : cluster 0 pgmap v663: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:25.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:25 smithi137 bash[27262]: audit 1689213204.972711 mon.d (mon.3) 10 : audit 0 from='client.? 172.21.15.22:0/908140047' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:25.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:25 smithi103 bash[27315]: cluster 1689213203.4217114 mgr.a (mgr.14152) 782 : cluster 0 pgmap v663: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:25.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:25 smithi103 bash[27315]: audit 1689213204.972711 mon.d (mon.3) 10 : audit 0 from='client.? 172.21.15.22:0/908140047' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:25.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:25 smithi084 bash[27323]: cluster 1689213203.4217114 mgr.a (mgr.14152) 782 : cluster 0 pgmap v663: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:25.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:25 smithi084 bash[27323]: audit 1689213204.972711 mon.d (mon.3) 10 : audit 0 from='client.? 172.21.15.22:0/908140047' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:25.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:25 smithi022 bash[26979]: cluster 1689213203.4217114 mgr.a (mgr.14152) 782 : cluster 0 pgmap v663: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:25.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:25 smithi022 bash[26979]: audit 1689213204.972711 mon.d (mon.3) 10 : audit 0 from='client.? 172.21.15.22:0/908140047' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:25.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:25 smithi154 bash[27744]: cluster 1689213203.4217114 mgr.a (mgr.14152) 782 : cluster 0 pgmap v663: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:25.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:25 smithi154 bash[27744]: audit 1689213204.972711 mon.d (mon.3) 10 : audit 0 from='client.? 172.21.15.22:0/908140047' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:25.641 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:53:26.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:53:27.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:27 smithi137 bash[27262]: cluster 1689213205.4222696 mgr.a (mgr.14152) 783 : cluster 0 pgmap v664: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:27.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:27 smithi103 bash[27315]: cluster 1689213205.4222696 mgr.a (mgr.14152) 783 : cluster 0 pgmap v664: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:27.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:27 smithi084 bash[27323]: cluster 1689213205.4222696 mgr.a (mgr.14152) 783 : cluster 0 pgmap v664: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:27.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:27 smithi022 bash[26979]: cluster 1689213205.4222696 mgr.a (mgr.14152) 783 : cluster 0 pgmap v664: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:27.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:27 smithi154 bash[27744]: cluster 1689213205.4222696 mgr.a (mgr.14152) 783 : cluster 0 pgmap v664: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:29.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:29 smithi137 bash[27262]: cluster 1689213207.422807 mgr.a (mgr.14152) 784 : cluster 0 pgmap v665: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:29.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:29 smithi103 bash[27315]: cluster 1689213207.422807 mgr.a (mgr.14152) 784 : cluster 0 pgmap v665: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:29.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:29 smithi084 bash[27323]: cluster 1689213207.422807 mgr.a (mgr.14152) 784 : cluster 0 pgmap v665: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:29.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:29 smithi022 bash[26979]: cluster 1689213207.422807 mgr.a (mgr.14152) 784 : cluster 0 pgmap v665: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:29.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:29 smithi154 bash[27744]: cluster 1689213207.422807 mgr.a (mgr.14152) 784 : cluster 0 pgmap v665: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:31.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:31 smithi137 bash[27262]: cluster 1689213209.4233212 mgr.a (mgr.14152) 785 : cluster 0 pgmap v666: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:31.335 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:53:31.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:31 smithi103 bash[27315]: cluster 1689213209.4233212 mgr.a (mgr.14152) 785 : cluster 0 pgmap v666: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:31.372 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:31 smithi022 bash[26979]: cluster 1689213209.4233212 mgr.a (mgr.14152) 785 : cluster 0 pgmap v666: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:31.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:31 smithi084 bash[27323]: cluster 1689213209.4233212 mgr.a (mgr.14152) 785 : cluster 0 pgmap v666: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:31.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:31 smithi154 bash[27744]: cluster 1689213209.4233212 mgr.a (mgr.14152) 785 : cluster 0 pgmap v666: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:33.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:33 smithi137 bash[27262]: cluster 1689213211.4238203 mgr.a (mgr.14152) 786 : cluster 0 pgmap v667: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:33.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:33 smithi103 bash[27315]: cluster 1689213211.4238203 mgr.a (mgr.14152) 786 : cluster 0 pgmap v667: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:33.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:33 smithi084 bash[27323]: cluster 1689213211.4238203 mgr.a (mgr.14152) 786 : cluster 0 pgmap v667: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:33.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:33 smithi022 bash[26979]: cluster 1689213211.4238203 mgr.a (mgr.14152) 786 : cluster 0 pgmap v667: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:33.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:33 smithi154 bash[27744]: cluster 1689213211.4238203 mgr.a (mgr.14152) 786 : cluster 0 pgmap v667: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:34.475 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:53:35.189 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:53:35.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:35 smithi137 bash[27262]: cluster 1689213213.4243612 mgr.a (mgr.14152) 787 : cluster 0 pgmap v668: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:35.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:35 smithi137 bash[27262]: audit 1689213214.4936664 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.22:0/2829545175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:35.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:35 smithi103 bash[27315]: cluster 1689213213.4243612 mgr.a (mgr.14152) 787 : cluster 0 pgmap v668: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:35.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:35 smithi103 bash[27315]: audit 1689213214.4936664 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.22:0/2829545175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:35.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:35 smithi084 bash[27323]: cluster 1689213213.4243612 mgr.a (mgr.14152) 787 : cluster 0 pgmap v668: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:35.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:35 smithi084 bash[27323]: audit 1689213214.4936664 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.22:0/2829545175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:35.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:35 smithi022 bash[26979]: cluster 1689213213.4243612 mgr.a (mgr.14152) 787 : cluster 0 pgmap v668: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:35.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:35 smithi022 bash[26979]: audit 1689213214.4936664 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.22:0/2829545175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:35.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:35 smithi154 bash[27744]: cluster 1689213213.4243612 mgr.a (mgr.14152) 787 : cluster 0 pgmap v668: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:35.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:35 smithi154 bash[27744]: audit 1689213214.4936664 mon.c (mon.2) 12 : audit 0 from='client.? 172.21.15.22:0/2829545175' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:36.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:53:37.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:37 smithi137 bash[27262]: cluster 1689213215.4249127 mgr.a (mgr.14152) 788 : cluster 0 pgmap v669: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:37.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:37 smithi103 bash[27315]: cluster 1689213215.4249127 mgr.a (mgr.14152) 788 : cluster 0 pgmap v669: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:37.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:37 smithi084 bash[27323]: cluster 1689213215.4249127 mgr.a (mgr.14152) 788 : cluster 0 pgmap v669: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:37.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:37 smithi022 bash[26979]: cluster 1689213215.4249127 mgr.a (mgr.14152) 788 : cluster 0 pgmap v669: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:37.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:37 smithi154 bash[27744]: cluster 1689213215.4249127 mgr.a (mgr.14152) 788 : cluster 0 pgmap v669: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:39.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:39 smithi137 bash[27262]: cluster 1689213217.42549 mgr.a (mgr.14152) 789 : cluster 0 pgmap v670: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:39.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:39 smithi103 bash[27315]: cluster 1689213217.42549 mgr.a (mgr.14152) 789 : cluster 0 pgmap v670: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:39.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:39 smithi084 bash[27323]: cluster 1689213217.42549 mgr.a (mgr.14152) 789 : cluster 0 pgmap v670: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:39.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:39 smithi022 bash[26979]: cluster 1689213217.42549 mgr.a (mgr.14152) 789 : cluster 0 pgmap v670: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:39.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:39 smithi154 bash[27744]: cluster 1689213217.42549 mgr.a (mgr.14152) 789 : cluster 0 pgmap v670: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:40.880 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:53:41.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:41 smithi137 bash[27262]: cluster 1689213219.4260626 mgr.a (mgr.14152) 790 : cluster 0 pgmap v671: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:41.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:41 smithi103 bash[27315]: cluster 1689213219.4260626 mgr.a (mgr.14152) 790 : cluster 0 pgmap v671: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:41.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:41 smithi084 bash[27323]: cluster 1689213219.4260626 mgr.a (mgr.14152) 790 : cluster 0 pgmap v671: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:41.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:41 smithi022 bash[26979]: cluster 1689213219.4260626 mgr.a (mgr.14152) 790 : cluster 0 pgmap v671: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:41.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:41 smithi154 bash[27744]: cluster 1689213219.4260626 mgr.a (mgr.14152) 790 : cluster 0 pgmap v671: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:43.152 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:43 smithi022 bash[26979]: cluster 1689213221.4265676 mgr.a (mgr.14152) 791 : cluster 0 pgmap v672: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:43.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:43 smithi103 bash[27315]: cluster 1689213221.4265676 mgr.a (mgr.14152) 791 : cluster 0 pgmap v672: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:43.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:43 smithi084 bash[27323]: cluster 1689213221.4265676 mgr.a (mgr.14152) 791 : cluster 0 pgmap v672: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:43.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:43 smithi154 bash[27744]: cluster 1689213221.4265676 mgr.a (mgr.14152) 791 : cluster 0 pgmap v672: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:43.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:43 smithi137 bash[27262]: cluster 1689213221.4265676 mgr.a (mgr.14152) 791 : cluster 0 pgmap v672: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:44.247 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:53:44.973 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:53:45.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:45 smithi103 bash[27315]: cluster 1689213223.4271328 mgr.a (mgr.14152) 792 : cluster 0 pgmap v673: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:45.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:45 smithi103 bash[27315]: audit 1689213224.2658074 mon.c (mon.2) 13 : audit 0 from='client.? 172.21.15.22:0/4266786999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:45.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:45 smithi084 bash[27323]: cluster 1689213223.4271328 mgr.a (mgr.14152) 792 : cluster 0 pgmap v673: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:45.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:45 smithi084 bash[27323]: audit 1689213224.2658074 mon.c (mon.2) 13 : audit 0 from='client.? 172.21.15.22:0/4266786999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:45.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:45 smithi022 bash[26979]: cluster 1689213223.4271328 mgr.a (mgr.14152) 792 : cluster 0 pgmap v673: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:45.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:45 smithi022 bash[26979]: audit 1689213224.2658074 mon.c (mon.2) 13 : audit 0 from='client.? 172.21.15.22:0/4266786999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:45.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:45 smithi154 bash[27744]: cluster 1689213223.4271328 mgr.a (mgr.14152) 792 : cluster 0 pgmap v673: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:45.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:45 smithi154 bash[27744]: audit 1689213224.2658074 mon.c (mon.2) 13 : audit 0 from='client.? 172.21.15.22:0/4266786999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:45.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:45 smithi137 bash[27262]: cluster 1689213223.4271328 mgr.a (mgr.14152) 792 : cluster 0 pgmap v673: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:45.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:45 smithi137 bash[27262]: audit 1689213224.2658074 mon.c (mon.2) 13 : audit 0 from='client.? 172.21.15.22:0/4266786999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:45.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:53:47.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:47 smithi103 bash[27315]: cluster 1689213225.4276516 mgr.a (mgr.14152) 793 : cluster 0 pgmap v674: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:47.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:47 smithi084 bash[27323]: cluster 1689213225.4276516 mgr.a (mgr.14152) 793 : cluster 0 pgmap v674: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:47.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:47 smithi022 bash[26979]: cluster 1689213225.4276516 mgr.a (mgr.14152) 793 : cluster 0 pgmap v674: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:47.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:47 smithi154 bash[27744]: cluster 1689213225.4276516 mgr.a (mgr.14152) 793 : cluster 0 pgmap v674: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:47.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:47 smithi137 bash[27262]: cluster 1689213225.4276516 mgr.a (mgr.14152) 793 : cluster 0 pgmap v674: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:49.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:49 smithi103 bash[27315]: cluster 1689213227.4281602 mgr.a (mgr.14152) 794 : cluster 0 pgmap v675: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:49.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:49 smithi084 bash[27323]: cluster 1689213227.4281602 mgr.a (mgr.14152) 794 : cluster 0 pgmap v675: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:49.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:49 smithi022 bash[26979]: cluster 1689213227.4281602 mgr.a (mgr.14152) 794 : cluster 0 pgmap v675: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:49.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:49 smithi154 bash[27744]: cluster 1689213227.4281602 mgr.a (mgr.14152) 794 : cluster 0 pgmap v675: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:49.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:49 smithi137 bash[27262]: cluster 1689213227.4281602 mgr.a (mgr.14152) 794 : cluster 0 pgmap v675: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:50.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:50 smithi103 bash[27315]: audit 1689213229.5884197 mon.a (mon.0) 1068 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:53:50.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:50 smithi103 bash[27315]: audit 1689213230.0172408 mon.a (mon.0) 1069 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:50 smithi103 bash[27315]: audit 1689213230.0245538 mon.a (mon.0) 1070 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:50 smithi084 bash[27323]: audit 1689213229.5884197 mon.a (mon.0) 1068 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:53:50.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:50 smithi084 bash[27323]: audit 1689213230.0172408 mon.a (mon.0) 1069 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:50 smithi084 bash[27323]: audit 1689213230.0245538 mon.a (mon.0) 1070 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:50 smithi022 bash[26979]: audit 1689213229.5884197 mon.a (mon.0) 1068 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:53:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:50 smithi022 bash[26979]: audit 1689213230.0172408 mon.a (mon.0) 1069 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:50 smithi022 bash[26979]: audit 1689213230.0245538 mon.a (mon.0) 1070 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:50 smithi154 bash[27744]: audit 1689213229.5884197 mon.a (mon.0) 1068 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:53:50.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:50 smithi154 bash[27744]: audit 1689213230.0172408 mon.a (mon.0) 1069 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:50 smithi154 bash[27744]: audit 1689213230.0245538 mon.a (mon.0) 1070 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:50 smithi137 bash[27262]: audit 1689213229.5884197 mon.a (mon.0) 1068 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:53:50.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:50 smithi137 bash[27262]: audit 1689213230.0172408 mon.a (mon.0) 1069 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:50 smithi137 bash[27262]: audit 1689213230.0245538 mon.a (mon.0) 1070 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:50.674 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:53:51.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:51 smithi103 bash[27315]: cluster 1689213229.4286969 mgr.a (mgr.14152) 795 : cluster 0 pgmap v676: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:51.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:51 smithi103 bash[27315]: audit 1689213230.771401 mon.a (mon.0) 1071 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:53:51.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:51 smithi103 bash[27315]: audit 1689213230.7728965 mon.a (mon.0) 1072 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:53:51.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:51 smithi103 bash[27315]: audit 1689213230.7840686 mon.a (mon.0) 1073 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:51.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:51 smithi084 bash[27323]: cluster 1689213229.4286969 mgr.a (mgr.14152) 795 : cluster 0 pgmap v676: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:51.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:51 smithi084 bash[27323]: audit 1689213230.771401 mon.a (mon.0) 1071 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:53:51.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:51 smithi084 bash[27323]: audit 1689213230.7728965 mon.a (mon.0) 1072 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:53:51.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:51 smithi084 bash[27323]: audit 1689213230.7840686 mon.a (mon.0) 1073 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:51.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:51 smithi022 bash[26979]: cluster 1689213229.4286969 mgr.a (mgr.14152) 795 : cluster 0 pgmap v676: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:51.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:51 smithi022 bash[26979]: audit 1689213230.771401 mon.a (mon.0) 1071 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:53:51.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:51 smithi022 bash[26979]: audit 1689213230.7728965 mon.a (mon.0) 1072 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:53:51.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:51 smithi022 bash[26979]: audit 1689213230.7840686 mon.a (mon.0) 1073 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:51.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:51 smithi154 bash[27744]: cluster 1689213229.4286969 mgr.a (mgr.14152) 795 : cluster 0 pgmap v676: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:51.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:51 smithi154 bash[27744]: audit 1689213230.771401 mon.a (mon.0) 1071 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:53:51.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:51 smithi154 bash[27744]: audit 1689213230.7728965 mon.a (mon.0) 1072 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:53:51.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:51 smithi154 bash[27744]: audit 1689213230.7840686 mon.a (mon.0) 1073 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:51.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:51 smithi137 bash[27262]: cluster 1689213229.4286969 mgr.a (mgr.14152) 795 : cluster 0 pgmap v676: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:51.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:51 smithi137 bash[27262]: audit 1689213230.771401 mon.a (mon.0) 1071 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:53:51.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:51 smithi137 bash[27262]: audit 1689213230.7728965 mon.a (mon.0) 1072 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:53:51.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:51 smithi137 bash[27262]: audit 1689213230.7840686 mon.a (mon.0) 1073 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:53:52.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:52 smithi103 bash[27315]: cluster 1689213230.7758136 mgr.a (mgr.14152) 796 : cluster 0 pgmap v677: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:52 smithi103 bash[27315]: cluster 1689213230.7761273 mgr.a (mgr.14152) 797 : cluster 0 pgmap v678: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:52 smithi084 bash[27323]: cluster 1689213230.7758136 mgr.a (mgr.14152) 796 : cluster 0 pgmap v677: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:52 smithi084 bash[27323]: cluster 1689213230.7761273 mgr.a (mgr.14152) 797 : cluster 0 pgmap v678: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:52 smithi022 bash[26979]: cluster 1689213230.7758136 mgr.a (mgr.14152) 796 : cluster 0 pgmap v677: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:52 smithi022 bash[26979]: cluster 1689213230.7761273 mgr.a (mgr.14152) 797 : cluster 0 pgmap v678: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:52 smithi154 bash[27744]: cluster 1689213230.7758136 mgr.a (mgr.14152) 796 : cluster 0 pgmap v677: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:52 smithi154 bash[27744]: cluster 1689213230.7761273 mgr.a (mgr.14152) 797 : cluster 0 pgmap v678: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:52 smithi137 bash[27262]: cluster 1689213230.7758136 mgr.a (mgr.14152) 796 : cluster 0 pgmap v677: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:52.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:52 smithi137 bash[27262]: cluster 1689213230.7761273 mgr.a (mgr.14152) 797 : cluster 0 pgmap v678: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:54.037 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:53:54.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:54 smithi084 bash[27323]: cluster 1689213232.7766156 mgr.a (mgr.14152) 798 : cluster 0 pgmap v679: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:54.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:54 smithi084 bash[27323]: audit 1689213234.0506196 mon.a (mon.0) 1074 : audit 0 from='client.? 172.21.15.22:0/194346604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:54.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:54 smithi022 bash[26979]: cluster 1689213232.7766156 mgr.a (mgr.14152) 798 : cluster 0 pgmap v679: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:54.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:54 smithi022 bash[26979]: audit 1689213234.0506196 mon.a (mon.0) 1074 : audit 0 from='client.? 172.21.15.22:0/194346604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:54.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:54 smithi154 bash[27744]: cluster 1689213232.7766156 mgr.a (mgr.14152) 798 : cluster 0 pgmap v679: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:54.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:54 smithi154 bash[27744]: audit 1689213234.0506196 mon.a (mon.0) 1074 : audit 0 from='client.? 172.21.15.22:0/194346604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:54.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:54 smithi137 bash[27262]: cluster 1689213232.7766156 mgr.a (mgr.14152) 798 : cluster 0 pgmap v679: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:54.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:54 smithi137 bash[27262]: audit 1689213234.0506196 mon.a (mon.0) 1074 : audit 0 from='client.? 172.21.15.22:0/194346604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:54.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:54 smithi103 bash[27315]: cluster 1689213232.7766156 mgr.a (mgr.14152) 798 : cluster 0 pgmap v679: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:54.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:54 smithi103 bash[27315]: audit 1689213234.0506196 mon.a (mon.0) 1074 : audit 0 from='client.? 172.21.15.22:0/194346604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:53:54.765 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:53:55.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:53:56.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:56 smithi084 bash[27323]: cluster 1689213234.7771761 mgr.a (mgr.14152) 799 : cluster 0 pgmap v680: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:56.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:56 smithi022 bash[26979]: cluster 1689213234.7771761 mgr.a (mgr.14152) 799 : cluster 0 pgmap v680: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:56.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:56 smithi154 bash[27744]: cluster 1689213234.7771761 mgr.a (mgr.14152) 799 : cluster 0 pgmap v680: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:56.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:56 smithi137 bash[27262]: cluster 1689213234.7771761 mgr.a (mgr.14152) 799 : cluster 0 pgmap v680: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:56.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:56 smithi103 bash[27315]: cluster 1689213234.7771761 mgr.a (mgr.14152) 799 : cluster 0 pgmap v680: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:58.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:53:58 smithi084 bash[27323]: cluster 1689213236.7777376 mgr.a (mgr.14152) 800 : cluster 0 pgmap v681: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:53:58 smithi022 bash[26979]: cluster 1689213236.7777376 mgr.a (mgr.14152) 800 : cluster 0 pgmap v681: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:58.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:53:58 smithi154 bash[27744]: cluster 1689213236.7777376 mgr.a (mgr.14152) 800 : cluster 0 pgmap v681: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:58.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:53:58 smithi137 bash[27262]: cluster 1689213236.7777376 mgr.a (mgr.14152) 800 : cluster 0 pgmap v681: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:53:58.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:53:58 smithi103 bash[27315]: cluster 1689213236.7777376 mgr.a (mgr.14152) 800 : cluster 0 pgmap v681: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:00.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:00 smithi084 bash[27323]: cluster 1689213238.7782402 mgr.a (mgr.14152) 801 : cluster 0 pgmap v682: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:00.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:00 smithi022 bash[26979]: cluster 1689213238.7782402 mgr.a (mgr.14152) 801 : cluster 0 pgmap v682: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:00.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:00 smithi154 bash[27744]: cluster 1689213238.7782402 mgr.a (mgr.14152) 801 : cluster 0 pgmap v682: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:00.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:00 smithi137 bash[27262]: cluster 1689213238.7782402 mgr.a (mgr.14152) 801 : cluster 0 pgmap v682: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:00.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:00 smithi103 bash[27315]: cluster 1689213238.7782402 mgr.a (mgr.14152) 801 : cluster 0 pgmap v682: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:02.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:02 smithi084 bash[27323]: cluster 1689213240.7787538 mgr.a (mgr.14152) 802 : cluster 0 pgmap v683: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:02.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:02 smithi022 bash[26979]: cluster 1689213240.7787538 mgr.a (mgr.14152) 802 : cluster 0 pgmap v683: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:02.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:02 smithi154 bash[27744]: cluster 1689213240.7787538 mgr.a (mgr.14152) 802 : cluster 0 pgmap v683: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:02.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:02 smithi137 bash[27262]: cluster 1689213240.7787538 mgr.a (mgr.14152) 802 : cluster 0 pgmap v683: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:02.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:02 smithi103 bash[27315]: cluster 1689213240.7787538 mgr.a (mgr.14152) 802 : cluster 0 pgmap v683: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:03.710 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:54:04.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:04 smithi084 bash[27323]: cluster 1689213242.779134 mgr.a (mgr.14152) 803 : cluster 0 pgmap v684: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:04.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:04 smithi084 bash[27323]: audit 1689213243.7231195 mon.a (mon.0) 1075 : audit 0 from='client.? 172.21.15.22:0/428122858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:04.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:04 smithi022 bash[26979]: cluster 1689213242.779134 mgr.a (mgr.14152) 803 : cluster 0 pgmap v684: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:04.429 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:04 smithi022 bash[26979]: audit 1689213243.7231195 mon.a (mon.0) 1075 : audit 0 from='client.? 172.21.15.22:0/428122858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:04.429 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:54:04.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:04 smithi154 bash[27744]: cluster 1689213242.779134 mgr.a (mgr.14152) 803 : cluster 0 pgmap v684: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:04.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:04 smithi154 bash[27744]: audit 1689213243.7231195 mon.a (mon.0) 1075 : audit 0 from='client.? 172.21.15.22:0/428122858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:04.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:04 smithi137 bash[27262]: cluster 1689213242.779134 mgr.a (mgr.14152) 803 : cluster 0 pgmap v684: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:04.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:04 smithi137 bash[27262]: audit 1689213243.7231195 mon.a (mon.0) 1075 : audit 0 from='client.? 172.21.15.22:0/428122858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:04.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:04 smithi103 bash[27315]: cluster 1689213242.779134 mgr.a (mgr.14152) 803 : cluster 0 pgmap v684: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:04.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:04 smithi103 bash[27315]: audit 1689213243.7231195 mon.a (mon.0) 1075 : audit 0 from='client.? 172.21.15.22:0/428122858' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:05.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:54:06.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:06 smithi084 bash[27323]: cluster 1689213244.779613 mgr.a (mgr.14152) 804 : cluster 0 pgmap v685: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:06.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:06 smithi022 bash[26979]: cluster 1689213244.779613 mgr.a (mgr.14152) 804 : cluster 0 pgmap v685: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:06.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:06 smithi154 bash[27744]: cluster 1689213244.779613 mgr.a (mgr.14152) 804 : cluster 0 pgmap v685: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:06.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:06 smithi137 bash[27262]: cluster 1689213244.779613 mgr.a (mgr.14152) 804 : cluster 0 pgmap v685: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:06.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:06 smithi103 bash[27315]: cluster 1689213244.779613 mgr.a (mgr.14152) 804 : cluster 0 pgmap v685: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:08.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:08 smithi084 bash[27323]: cluster 1689213246.780064 mgr.a (mgr.14152) 805 : cluster 0 pgmap v686: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:08.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:08 smithi022 bash[26979]: cluster 1689213246.780064 mgr.a (mgr.14152) 805 : cluster 0 pgmap v686: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:08.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:08 smithi154 bash[27744]: cluster 1689213246.780064 mgr.a (mgr.14152) 805 : cluster 0 pgmap v686: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:08.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:08 smithi137 bash[27262]: cluster 1689213246.780064 mgr.a (mgr.14152) 805 : cluster 0 pgmap v686: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:08.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:08 smithi103 bash[27315]: cluster 1689213246.780064 mgr.a (mgr.14152) 805 : cluster 0 pgmap v686: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:10.127 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:10.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:10 smithi084 bash[27323]: cluster 1689213248.7806685 mgr.a (mgr.14152) 806 : cluster 0 pgmap v687: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:10.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:10 smithi022 bash[26979]: cluster 1689213248.7806685 mgr.a (mgr.14152) 806 : cluster 0 pgmap v687: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:10.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:10 smithi154 bash[27744]: cluster 1689213248.7806685 mgr.a (mgr.14152) 806 : cluster 0 pgmap v687: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:10.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:10 smithi137 bash[27262]: cluster 1689213248.7806685 mgr.a (mgr.14152) 806 : cluster 0 pgmap v687: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:10.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:10 smithi103 bash[27315]: cluster 1689213248.7806685 mgr.a (mgr.14152) 806 : cluster 0 pgmap v687: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:12.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:12 smithi084 bash[27323]: cluster 1689213250.7812016 mgr.a (mgr.14152) 807 : cluster 0 pgmap v688: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:12.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:12 smithi022 bash[26979]: cluster 1689213250.7812016 mgr.a (mgr.14152) 807 : cluster 0 pgmap v688: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:12.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:12 smithi154 bash[27744]: cluster 1689213250.7812016 mgr.a (mgr.14152) 807 : cluster 0 pgmap v688: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:12.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:12 smithi137 bash[27262]: cluster 1689213250.7812016 mgr.a (mgr.14152) 807 : cluster 0 pgmap v688: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:12.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:12 smithi103 bash[27315]: cluster 1689213250.7812016 mgr.a (mgr.14152) 807 : cluster 0 pgmap v688: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:13.380 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:54:14.105 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:54:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:14 smithi022 bash[26979]: cluster 1689213252.7816515 mgr.a (mgr.14152) 808 : cluster 0 pgmap v689: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:14.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:14 smithi022 bash[26979]: audit 1689213253.3936584 mon.a (mon.0) 1076 : audit 0 from='client.? 172.21.15.22:0/196442553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:14.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:14 smithi154 bash[27744]: cluster 1689213252.7816515 mgr.a (mgr.14152) 808 : cluster 0 pgmap v689: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:14.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:14 smithi154 bash[27744]: audit 1689213253.3936584 mon.a (mon.0) 1076 : audit 0 from='client.? 172.21.15.22:0/196442553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:14.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:14 smithi137 bash[27262]: cluster 1689213252.7816515 mgr.a (mgr.14152) 808 : cluster 0 pgmap v689: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:14.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:14 smithi137 bash[27262]: audit 1689213253.3936584 mon.a (mon.0) 1076 : audit 0 from='client.? 172.21.15.22:0/196442553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:14.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:14 smithi103 bash[27315]: cluster 1689213252.7816515 mgr.a (mgr.14152) 808 : cluster 0 pgmap v689: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:14.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:14 smithi103 bash[27315]: audit 1689213253.3936584 mon.a (mon.0) 1076 : audit 0 from='client.? 172.21.15.22:0/196442553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:14.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:14 smithi084 bash[27323]: cluster 1689213252.7816515 mgr.a (mgr.14152) 808 : cluster 0 pgmap v689: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:14.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:14 smithi084 bash[27323]: audit 1689213253.3936584 mon.a (mon.0) 1076 : audit 0 from='client.? 172.21.15.22:0/196442553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:15.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:54:16.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:16 smithi022 bash[26979]: cluster 1689213254.7821403 mgr.a (mgr.14152) 809 : cluster 0 pgmap v690: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:16.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:16 smithi154 bash[27744]: cluster 1689213254.7821403 mgr.a (mgr.14152) 809 : cluster 0 pgmap v690: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:16.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:16 smithi137 bash[27262]: cluster 1689213254.7821403 mgr.a (mgr.14152) 809 : cluster 0 pgmap v690: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:16.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:16 smithi103 bash[27315]: cluster 1689213254.7821403 mgr.a (mgr.14152) 809 : cluster 0 pgmap v690: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:16.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:16 smithi084 bash[27323]: cluster 1689213254.7821403 mgr.a (mgr.14152) 809 : cluster 0 pgmap v690: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:18.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:18 smithi022 bash[26979]: cluster 1689213256.7826445 mgr.a (mgr.14152) 810 : cluster 0 pgmap v691: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:18.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:18 smithi154 bash[27744]: cluster 1689213256.7826445 mgr.a (mgr.14152) 810 : cluster 0 pgmap v691: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:18.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:18 smithi137 bash[27262]: cluster 1689213256.7826445 mgr.a (mgr.14152) 810 : cluster 0 pgmap v691: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:18.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:18 smithi103 bash[27315]: cluster 1689213256.7826445 mgr.a (mgr.14152) 810 : cluster 0 pgmap v691: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:18.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:18 smithi084 bash[27323]: cluster 1689213256.7826445 mgr.a (mgr.14152) 810 : cluster 0 pgmap v691: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:20.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:20 smithi022 bash[26979]: cluster 1689213258.7831714 mgr.a (mgr.14152) 811 : cluster 0 pgmap v692: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:20.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:20 smithi154 bash[27744]: cluster 1689213258.7831714 mgr.a (mgr.14152) 811 : cluster 0 pgmap v692: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:20.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:20 smithi137 bash[27262]: cluster 1689213258.7831714 mgr.a (mgr.14152) 811 : cluster 0 pgmap v692: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:20.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:20 smithi103 bash[27315]: cluster 1689213258.7831714 mgr.a (mgr.14152) 811 : cluster 0 pgmap v692: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:20.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:20 smithi084 bash[27323]: cluster 1689213258.7831714 mgr.a (mgr.14152) 811 : cluster 0 pgmap v692: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:22.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:22 smithi154 bash[27744]: cluster 1689213260.7837353 mgr.a (mgr.14152) 812 : cluster 0 pgmap v693: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:22.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:22 smithi137 bash[27262]: cluster 1689213260.7837353 mgr.a (mgr.14152) 812 : cluster 0 pgmap v693: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:22.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:22 smithi103 bash[27315]: cluster 1689213260.7837353 mgr.a (mgr.14152) 812 : cluster 0 pgmap v693: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:22.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:22 smithi084 bash[27323]: cluster 1689213260.7837353 mgr.a (mgr.14152) 812 : cluster 0 pgmap v693: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:22.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:22 smithi022 bash[26979]: cluster 1689213260.7837353 mgr.a (mgr.14152) 812 : cluster 0 pgmap v693: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:23.147 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:54:23.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:23 smithi154 bash[27744]: audit 1689213263.164644 mon.b (mon.4) 21 : audit 0 from='client.? 172.21.15.22:0/3611789331' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:23.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:23 smithi137 bash[27262]: audit 1689213263.164644 mon.b (mon.4) 21 : audit 0 from='client.? 172.21.15.22:0/3611789331' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:23.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:23 smithi103 bash[27315]: audit 1689213263.164644 mon.b (mon.4) 21 : audit 0 from='client.? 172.21.15.22:0/3611789331' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:23.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:23 smithi084 bash[27323]: audit 1689213263.164644 mon.b (mon.4) 21 : audit 0 from='client.? 172.21.15.22:0/3611789331' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:23.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:23 smithi022 bash[26979]: audit 1689213263.164644 mon.b (mon.4) 21 : audit 0 from='client.? 172.21.15.22:0/3611789331' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:23.845 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:54:24.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:24 smithi154 bash[27744]: cluster 1689213262.784135 mgr.a (mgr.14152) 813 : cluster 0 pgmap v694: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:24.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:24 smithi137 bash[27262]: cluster 1689213262.784135 mgr.a (mgr.14152) 813 : cluster 0 pgmap v694: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:24.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:24 smithi103 bash[27315]: cluster 1689213262.784135 mgr.a (mgr.14152) 813 : cluster 0 pgmap v694: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:24.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:24 smithi084 bash[27323]: cluster 1689213262.784135 mgr.a (mgr.14152) 813 : cluster 0 pgmap v694: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:24.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:24 smithi022 bash[26979]: cluster 1689213262.784135 mgr.a (mgr.14152) 813 : cluster 0 pgmap v694: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:24.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:54:26.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:26 smithi154 bash[27744]: cluster 1689213264.784591 mgr.a (mgr.14152) 814 : cluster 0 pgmap v695: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:26.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:26 smithi137 bash[27262]: cluster 1689213264.784591 mgr.a (mgr.14152) 814 : cluster 0 pgmap v695: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:26.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:26 smithi103 bash[27315]: cluster 1689213264.784591 mgr.a (mgr.14152) 814 : cluster 0 pgmap v695: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:26.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:26 smithi084 bash[27323]: cluster 1689213264.784591 mgr.a (mgr.14152) 814 : cluster 0 pgmap v695: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:26.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:26 smithi022 bash[26979]: cluster 1689213264.784591 mgr.a (mgr.14152) 814 : cluster 0 pgmap v695: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:28.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:28 smithi154 bash[27744]: cluster 1689213266.7851124 mgr.a (mgr.14152) 815 : cluster 0 pgmap v696: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:28.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:28 smithi137 bash[27262]: cluster 1689213266.7851124 mgr.a (mgr.14152) 815 : cluster 0 pgmap v696: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:28.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:28 smithi103 bash[27315]: cluster 1689213266.7851124 mgr.a (mgr.14152) 815 : cluster 0 pgmap v696: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:28.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:28 smithi084 bash[27323]: cluster 1689213266.7851124 mgr.a (mgr.14152) 815 : cluster 0 pgmap v696: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:28.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:28 smithi022 bash[26979]: cluster 1689213266.7851124 mgr.a (mgr.14152) 815 : cluster 0 pgmap v696: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:29.552 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:30.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:30 smithi154 bash[27744]: cluster 1689213268.7856307 mgr.a (mgr.14152) 816 : cluster 0 pgmap v697: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:30.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:30 smithi137 bash[27262]: cluster 1689213268.7856307 mgr.a (mgr.14152) 816 : cluster 0 pgmap v697: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:30.569 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:30 smithi022 bash[26979]: cluster 1689213268.7856307 mgr.a (mgr.14152) 816 : cluster 0 pgmap v697: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:30.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:30 smithi103 bash[27315]: cluster 1689213268.7856307 mgr.a (mgr.14152) 816 : cluster 0 pgmap v697: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:30.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:30 smithi084 bash[27323]: cluster 1689213268.7856307 mgr.a (mgr.14152) 816 : cluster 0 pgmap v697: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:32.488 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:32 smithi022 bash[26979]: cluster 1689213270.7859464 mgr.a (mgr.14152) 817 : cluster 0 pgmap v698: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:32.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:32 smithi154 bash[27744]: cluster 1689213270.7859464 mgr.a (mgr.14152) 817 : cluster 0 pgmap v698: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:32.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:32 smithi137 bash[27262]: cluster 1689213270.7859464 mgr.a (mgr.14152) 817 : cluster 0 pgmap v698: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:32.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:32 smithi103 bash[27315]: cluster 1689213270.7859464 mgr.a (mgr.14152) 817 : cluster 0 pgmap v698: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:32.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:32 smithi084 bash[27323]: cluster 1689213270.7859464 mgr.a (mgr.14152) 817 : cluster 0 pgmap v698: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:32.873 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:54:33.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:33 smithi022 bash[26979]: audit 1689213272.8869214 mon.a (mon.0) 1077 : audit 0 from='client.? 172.21.15.22:0/1530056246' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:33.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:33 smithi154 bash[27744]: audit 1689213272.8869214 mon.a (mon.0) 1077 : audit 0 from='client.? 172.21.15.22:0/1530056246' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:33.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:33 smithi137 bash[27262]: audit 1689213272.8869214 mon.a (mon.0) 1077 : audit 0 from='client.? 172.21.15.22:0/1530056246' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:33.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:33 smithi103 bash[27315]: audit 1689213272.8869214 mon.a (mon.0) 1077 : audit 0 from='client.? 172.21.15.22:0/1530056246' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:33.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:33 smithi084 bash[27323]: audit 1689213272.8869214 mon.a (mon.0) 1077 : audit 0 from='client.? 172.21.15.22:0/1530056246' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:33.646 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:54:34.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:34 smithi154 bash[27744]: cluster 1689213272.7863386 mgr.a (mgr.14152) 818 : cluster 0 pgmap v699: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:34.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:34 smithi137 bash[27262]: cluster 1689213272.7863386 mgr.a (mgr.14152) 818 : cluster 0 pgmap v699: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:34.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:34 smithi103 bash[27315]: cluster 1689213272.7863386 mgr.a (mgr.14152) 818 : cluster 0 pgmap v699: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:34.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:34 smithi084 bash[27323]: cluster 1689213272.7863386 mgr.a (mgr.14152) 818 : cluster 0 pgmap v699: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:34.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:54:34.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:34 smithi022 bash[26979]: cluster 1689213272.7863386 mgr.a (mgr.14152) 818 : cluster 0 pgmap v699: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:36.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:36 smithi154 bash[27744]: cluster 1689213274.7868662 mgr.a (mgr.14152) 819 : cluster 0 pgmap v700: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:36.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:36 smithi137 bash[27262]: cluster 1689213274.7868662 mgr.a (mgr.14152) 819 : cluster 0 pgmap v700: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:36.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:36 smithi103 bash[27315]: cluster 1689213274.7868662 mgr.a (mgr.14152) 819 : cluster 0 pgmap v700: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:36.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:36 smithi084 bash[27323]: cluster 1689213274.7868662 mgr.a (mgr.14152) 819 : cluster 0 pgmap v700: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:36.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:36 smithi022 bash[26979]: cluster 1689213274.7868662 mgr.a (mgr.14152) 819 : cluster 0 pgmap v700: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:38.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:38 smithi154 bash[27744]: cluster 1689213276.7873526 mgr.a (mgr.14152) 820 : cluster 0 pgmap v701: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:38.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:38 smithi137 bash[27262]: cluster 1689213276.7873526 mgr.a (mgr.14152) 820 : cluster 0 pgmap v701: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:38.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:38 smithi103 bash[27315]: cluster 1689213276.7873526 mgr.a (mgr.14152) 820 : cluster 0 pgmap v701: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:38.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:38 smithi084 bash[27323]: cluster 1689213276.7873526 mgr.a (mgr.14152) 820 : cluster 0 pgmap v701: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:38.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:38 smithi022 bash[26979]: cluster 1689213276.7873526 mgr.a (mgr.14152) 820 : cluster 0 pgmap v701: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:39.343 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:40.455 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:40 smithi022 bash[26979]: cluster 1689213278.7878985 mgr.a (mgr.14152) 821 : cluster 0 pgmap v702: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:40.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:40 smithi154 bash[27744]: cluster 1689213278.7878985 mgr.a (mgr.14152) 821 : cluster 0 pgmap v702: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:40.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:40 smithi137 bash[27262]: cluster 1689213278.7878985 mgr.a (mgr.14152) 821 : cluster 0 pgmap v702: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:40.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:40 smithi103 bash[27315]: cluster 1689213278.7878985 mgr.a (mgr.14152) 821 : cluster 0 pgmap v702: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:40.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:40 smithi084 bash[27323]: cluster 1689213278.7878985 mgr.a (mgr.14152) 821 : cluster 0 pgmap v702: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:42.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:42 smithi154 bash[27744]: cluster 1689213280.7882316 mgr.a (mgr.14152) 822 : cluster 0 pgmap v703: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:42.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:42 smithi137 bash[27262]: cluster 1689213280.7882316 mgr.a (mgr.14152) 822 : cluster 0 pgmap v703: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:42.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:42 smithi103 bash[27315]: cluster 1689213280.7882316 mgr.a (mgr.14152) 822 : cluster 0 pgmap v703: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:42.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:42 smithi084 bash[27323]: cluster 1689213280.7882316 mgr.a (mgr.14152) 822 : cluster 0 pgmap v703: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:42.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:42 smithi022 bash[26979]: cluster 1689213280.7882316 mgr.a (mgr.14152) 822 : cluster 0 pgmap v703: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:42.744 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:54:43.459 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:54:43.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:43 smithi154 bash[27744]: audit 1689213282.7656116 mon.e (mon.1) 16 : audit 0 from='client.? 172.21.15.22:0/682946454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:43.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:43 smithi137 bash[27262]: audit 1689213282.7656116 mon.e (mon.1) 16 : audit 0 from='client.? 172.21.15.22:0/682946454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:43.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:43 smithi103 bash[27315]: audit 1689213282.7656116 mon.e (mon.1) 16 : audit 0 from='client.? 172.21.15.22:0/682946454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:43.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:43 smithi084 bash[27323]: audit 1689213282.7656116 mon.e (mon.1) 16 : audit 0 from='client.? 172.21.15.22:0/682946454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:43.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:43 smithi022 bash[26979]: audit 1689213282.7656116 mon.e (mon.1) 16 : audit 0 from='client.? 172.21.15.22:0/682946454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:44.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:54:44.474 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:44 smithi022 bash[26979]: cluster 1689213282.788588 mgr.a (mgr.14152) 823 : cluster 0 pgmap v704: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:44.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:44 smithi154 bash[27744]: cluster 1689213282.788588 mgr.a (mgr.14152) 823 : cluster 0 pgmap v704: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:44.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:44 smithi137 bash[27262]: cluster 1689213282.788588 mgr.a (mgr.14152) 823 : cluster 0 pgmap v704: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:44.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:44 smithi103 bash[27315]: cluster 1689213282.788588 mgr.a (mgr.14152) 823 : cluster 0 pgmap v704: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:44.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:44 smithi084 bash[27323]: cluster 1689213282.788588 mgr.a (mgr.14152) 823 : cluster 0 pgmap v704: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:46.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:46 smithi154 bash[27744]: cluster 1689213284.7890959 mgr.a (mgr.14152) 824 : cluster 0 pgmap v705: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:46.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:46 smithi137 bash[27262]: cluster 1689213284.7890959 mgr.a (mgr.14152) 824 : cluster 0 pgmap v705: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:46.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:46 smithi103 bash[27315]: cluster 1689213284.7890959 mgr.a (mgr.14152) 824 : cluster 0 pgmap v705: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:46.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:46 smithi084 bash[27323]: cluster 1689213284.7890959 mgr.a (mgr.14152) 824 : cluster 0 pgmap v705: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:46.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:46 smithi022 bash[26979]: cluster 1689213284.7890959 mgr.a (mgr.14152) 824 : cluster 0 pgmap v705: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:48.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:48 smithi154 bash[27744]: cluster 1689213286.7896242 mgr.a (mgr.14152) 825 : cluster 0 pgmap v706: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:48.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:48 smithi137 bash[27262]: cluster 1689213286.7896242 mgr.a (mgr.14152) 825 : cluster 0 pgmap v706: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:48.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:48 smithi103 bash[27315]: cluster 1689213286.7896242 mgr.a (mgr.14152) 825 : cluster 0 pgmap v706: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:48.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:48 smithi084 bash[27323]: cluster 1689213286.7896242 mgr.a (mgr.14152) 825 : cluster 0 pgmap v706: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:48.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:48 smithi022 bash[26979]: cluster 1689213286.7896242 mgr.a (mgr.14152) 825 : cluster 0 pgmap v706: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:49.156 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:50.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:50 smithi154 bash[27744]: cluster 1689213288.7901561 mgr.a (mgr.14152) 826 : cluster 0 pgmap v707: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:50.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:50 smithi022 bash[26979]: cluster 1689213288.7901561 mgr.a (mgr.14152) 826 : cluster 0 pgmap v707: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:50.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:50 smithi137 bash[27262]: cluster 1689213288.7901561 mgr.a (mgr.14152) 826 : cluster 0 pgmap v707: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:50.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:50 smithi103 bash[27315]: cluster 1689213288.7901561 mgr.a (mgr.14152) 826 : cluster 0 pgmap v707: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:50.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:50 smithi084 bash[27323]: cluster 1689213288.7901561 mgr.a (mgr.14152) 826 : cluster 0 pgmap v707: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:51.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:51 smithi154 bash[27744]: audit 1689213290.9497454 mon.a (mon.0) 1078 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:54:51.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:51 smithi137 bash[27262]: audit 1689213290.9497454 mon.a (mon.0) 1078 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:54:51.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:51 smithi103 bash[27315]: audit 1689213290.9497454 mon.a (mon.0) 1078 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:54:51.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:51 smithi084 bash[27323]: audit 1689213290.9497454 mon.a (mon.0) 1078 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:54:51.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:51 smithi022 bash[26979]: audit 1689213290.9497454 mon.a (mon.0) 1078 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:54:52.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:52 smithi022 bash[26979]: cluster 1689213290.7906344 mgr.a (mgr.14152) 827 : cluster 0 pgmap v708: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:52 smithi022 bash[26979]: audit 1689213291.646802 mon.a (mon.0) 1079 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:52 smithi022 bash[26979]: audit 1689213291.654253 mon.a (mon.0) 1080 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:52 smithi022 bash[26979]: audit 1689213292.1269443 mon.a (mon.0) 1081 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:54:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:52 smithi022 bash[26979]: audit 1689213292.1288106 mon.a (mon.0) 1082 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:54:52.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:52 smithi022 bash[26979]: audit 1689213292.1414425 mon.a (mon.0) 1083 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:52 smithi154 bash[27744]: cluster 1689213290.7906344 mgr.a (mgr.14152) 827 : cluster 0 pgmap v708: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:52.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:52 smithi154 bash[27744]: audit 1689213291.646802 mon.a (mon.0) 1079 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:52 smithi154 bash[27744]: audit 1689213291.654253 mon.a (mon.0) 1080 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:52 smithi154 bash[27744]: audit 1689213292.1269443 mon.a (mon.0) 1081 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:54:52.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:52 smithi154 bash[27744]: audit 1689213292.1288106 mon.a (mon.0) 1082 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:54:52.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:52 smithi154 bash[27744]: audit 1689213292.1414425 mon.a (mon.0) 1083 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:52 smithi137 bash[27262]: cluster 1689213290.7906344 mgr.a (mgr.14152) 827 : cluster 0 pgmap v708: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:52.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:52 smithi137 bash[27262]: audit 1689213291.646802 mon.a (mon.0) 1079 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:52 smithi137 bash[27262]: audit 1689213291.654253 mon.a (mon.0) 1080 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:52 smithi137 bash[27262]: audit 1689213292.1269443 mon.a (mon.0) 1081 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:54:52.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:52 smithi137 bash[27262]: audit 1689213292.1288106 mon.a (mon.0) 1082 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:54:52.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:52 smithi137 bash[27262]: audit 1689213292.1414425 mon.a (mon.0) 1083 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.567 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:54:52.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:52 smithi103 bash[27315]: cluster 1689213290.7906344 mgr.a (mgr.14152) 827 : cluster 0 pgmap v708: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:52.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:52 smithi103 bash[27315]: audit 1689213291.646802 mon.a (mon.0) 1079 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:52 smithi103 bash[27315]: audit 1689213291.654253 mon.a (mon.0) 1080 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:52 smithi103 bash[27315]: audit 1689213292.1269443 mon.a (mon.0) 1081 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:54:52.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:52 smithi103 bash[27315]: audit 1689213292.1288106 mon.a (mon.0) 1082 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:54:52.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:52 smithi103 bash[27315]: audit 1689213292.1414425 mon.a (mon.0) 1083 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:52 smithi084 bash[27323]: cluster 1689213290.7906344 mgr.a (mgr.14152) 827 : cluster 0 pgmap v708: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:52.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:52 smithi084 bash[27323]: audit 1689213291.646802 mon.a (mon.0) 1079 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:52 smithi084 bash[27323]: audit 1689213291.654253 mon.a (mon.0) 1080 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:52.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:52 smithi084 bash[27323]: audit 1689213292.1269443 mon.a (mon.0) 1081 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:54:52.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:52 smithi084 bash[27323]: audit 1689213292.1288106 mon.a (mon.0) 1082 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:54:52.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:52 smithi084 bash[27323]: audit 1689213292.1414425 mon.a (mon.0) 1083 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:54:53.306 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:54:53.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:53 smithi154 bash[27744]: cluster 1689213292.13413 mgr.a (mgr.14152) 828 : cluster 0 pgmap v709: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:53 smithi154 bash[27744]: cluster 1689213292.1345456 mgr.a (mgr.14152) 829 : cluster 0 pgmap v710: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:53 smithi154 bash[27744]: audit 1689213292.5869176 mon.d (mon.3) 11 : audit 0 from='client.? 172.21.15.22:0/912459960' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:53.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:53 smithi137 bash[27262]: cluster 1689213292.13413 mgr.a (mgr.14152) 828 : cluster 0 pgmap v709: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:53 smithi137 bash[27262]: cluster 1689213292.1345456 mgr.a (mgr.14152) 829 : cluster 0 pgmap v710: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:53 smithi137 bash[27262]: audit 1689213292.5869176 mon.d (mon.3) 11 : audit 0 from='client.? 172.21.15.22:0/912459960' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:53.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:53 smithi103 bash[27315]: cluster 1689213292.13413 mgr.a (mgr.14152) 828 : cluster 0 pgmap v709: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:53 smithi103 bash[27315]: cluster 1689213292.1345456 mgr.a (mgr.14152) 829 : cluster 0 pgmap v710: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:53 smithi103 bash[27315]: audit 1689213292.5869176 mon.d (mon.3) 11 : audit 0 from='client.? 172.21.15.22:0/912459960' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:53.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:53 smithi084 bash[27323]: cluster 1689213292.13413 mgr.a (mgr.14152) 828 : cluster 0 pgmap v709: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:53 smithi084 bash[27323]: cluster 1689213292.1345456 mgr.a (mgr.14152) 829 : cluster 0 pgmap v710: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:53 smithi084 bash[27323]: audit 1689213292.5869176 mon.d (mon.3) 11 : audit 0 from='client.? 172.21.15.22:0/912459960' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:53.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:53 smithi022 bash[26979]: cluster 1689213292.13413 mgr.a (mgr.14152) 828 : cluster 0 pgmap v709: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:53 smithi022 bash[26979]: cluster 1689213292.1345456 mgr.a (mgr.14152) 829 : cluster 0 pgmap v710: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:53 smithi022 bash[26979]: audit 1689213292.5869176 mon.d (mon.3) 11 : audit 0 from='client.? 172.21.15.22:0/912459960' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:54:54.307 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:54:55.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:55 smithi137 bash[27262]: cluster 1689213294.1350398 mgr.a (mgr.14152) 830 : cluster 0 pgmap v711: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:55.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:55 smithi103 bash[27315]: cluster 1689213294.1350398 mgr.a (mgr.14152) 830 : cluster 0 pgmap v711: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:55.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:55 smithi084 bash[27323]: cluster 1689213294.1350398 mgr.a (mgr.14152) 830 : cluster 0 pgmap v711: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:55.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:55 smithi022 bash[26979]: cluster 1689213294.1350398 mgr.a (mgr.14152) 830 : cluster 0 pgmap v711: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:55.746 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:55 smithi154 bash[27744]: cluster 1689213294.1350398 mgr.a (mgr.14152) 830 : cluster 0 pgmap v711: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:57.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:57 smithi137 bash[27262]: cluster 1689213296.135508 mgr.a (mgr.14152) 831 : cluster 0 pgmap v712: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:57.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:57 smithi103 bash[27315]: cluster 1689213296.135508 mgr.a (mgr.14152) 831 : cluster 0 pgmap v712: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:57.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:57 smithi084 bash[27323]: cluster 1689213296.135508 mgr.a (mgr.14152) 831 : cluster 0 pgmap v712: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:57.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:57 smithi022 bash[26979]: cluster 1689213296.135508 mgr.a (mgr.14152) 831 : cluster 0 pgmap v712: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:57.746 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:57 smithi154 bash[27744]: cluster 1689213296.135508 mgr.a (mgr.14152) 831 : cluster 0 pgmap v712: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:58.995 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:54:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:54:59 smithi022 bash[26979]: cluster 1689213298.1360276 mgr.a (mgr.14152) 832 : cluster 0 pgmap v713: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:54:59 smithi137 bash[27262]: cluster 1689213298.1360276 mgr.a (mgr.14152) 832 : cluster 0 pgmap v713: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:59.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:54:59 smithi103 bash[27315]: cluster 1689213298.1360276 mgr.a (mgr.14152) 832 : cluster 0 pgmap v713: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:54:59 smithi084 bash[27323]: cluster 1689213298.1360276 mgr.a (mgr.14152) 832 : cluster 0 pgmap v713: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:54:59.746 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:54:59 smithi154 bash[27744]: cluster 1689213298.1360276 mgr.a (mgr.14152) 832 : cluster 0 pgmap v713: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:01.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:00 smithi154 bash[27744]: cluster 1689213300.1366007 mgr.a (mgr.14152) 833 : cluster 0 pgmap v714: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:01.294 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:00 smithi137 bash[27262]: cluster 1689213300.1366007 mgr.a (mgr.14152) 833 : cluster 0 pgmap v714: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:01.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:00 smithi103 bash[27315]: cluster 1689213300.1366007 mgr.a (mgr.14152) 833 : cluster 0 pgmap v714: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:01.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:00 smithi084 bash[27323]: cluster 1689213300.1366007 mgr.a (mgr.14152) 833 : cluster 0 pgmap v714: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:01.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:00 smithi022 bash[26979]: cluster 1689213300.1366007 mgr.a (mgr.14152) 833 : cluster 0 pgmap v714: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:02.463 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:55:03.193 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:55:03.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:03 smithi154 bash[27744]: cluster 1689213302.1369977 mgr.a (mgr.14152) 834 : cluster 0 pgmap v715: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:03.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:03 smithi154 bash[27744]: audit 1689213302.4819283 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.22:0/461814054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:03.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:03 smithi137 bash[27262]: cluster 1689213302.1369977 mgr.a (mgr.14152) 834 : cluster 0 pgmap v715: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:03.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:03 smithi137 bash[27262]: audit 1689213302.4819283 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.22:0/461814054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:03.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:03 smithi103 bash[27315]: cluster 1689213302.1369977 mgr.a (mgr.14152) 834 : cluster 0 pgmap v715: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:03.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:03 smithi103 bash[27315]: audit 1689213302.4819283 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.22:0/461814054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:03.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:03 smithi084 bash[27323]: cluster 1689213302.1369977 mgr.a (mgr.14152) 834 : cluster 0 pgmap v715: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:03.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:03 smithi084 bash[27323]: audit 1689213302.4819283 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.22:0/461814054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:03.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:03 smithi022 bash[26979]: cluster 1689213302.1369977 mgr.a (mgr.14152) 834 : cluster 0 pgmap v715: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:03.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:03 smithi022 bash[26979]: audit 1689213302.4819283 mon.c (mon.2) 14 : audit 0 from='client.? 172.21.15.22:0/461814054' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:04.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:55:05.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:05 smithi154 bash[27744]: cluster 1689213304.137495 mgr.a (mgr.14152) 835 : cluster 0 pgmap v716: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:05.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:05 smithi137 bash[27262]: cluster 1689213304.137495 mgr.a (mgr.14152) 835 : cluster 0 pgmap v716: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:05.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:05 smithi103 bash[27315]: cluster 1689213304.137495 mgr.a (mgr.14152) 835 : cluster 0 pgmap v716: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:05.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:05 smithi084 bash[27323]: cluster 1689213304.137495 mgr.a (mgr.14152) 835 : cluster 0 pgmap v716: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:05.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:05 smithi022 bash[26979]: cluster 1689213304.137495 mgr.a (mgr.14152) 835 : cluster 0 pgmap v716: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:07.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:07 smithi154 bash[27744]: cluster 1689213306.1379855 mgr.a (mgr.14152) 836 : cluster 0 pgmap v717: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:07.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:07 smithi137 bash[27262]: cluster 1689213306.1379855 mgr.a (mgr.14152) 836 : cluster 0 pgmap v717: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:07.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:07 smithi103 bash[27315]: cluster 1689213306.1379855 mgr.a (mgr.14152) 836 : cluster 0 pgmap v717: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:07.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:07 smithi084 bash[27323]: cluster 1689213306.1379855 mgr.a (mgr.14152) 836 : cluster 0 pgmap v717: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:07.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:07 smithi022 bash[26979]: cluster 1689213306.1379855 mgr.a (mgr.14152) 836 : cluster 0 pgmap v717: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:55:09.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:09 smithi154 bash[27744]: cluster 1689213308.138468 mgr.a (mgr.14152) 837 : cluster 0 pgmap v718: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:09.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:09 smithi137 bash[27262]: cluster 1689213308.138468 mgr.a (mgr.14152) 837 : cluster 0 pgmap v718: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:09.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:09 smithi103 bash[27315]: cluster 1689213308.138468 mgr.a (mgr.14152) 837 : cluster 0 pgmap v718: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:09.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:09 smithi084 bash[27323]: cluster 1689213308.138468 mgr.a (mgr.14152) 837 : cluster 0 pgmap v718: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:09.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:09 smithi022 bash[26979]: cluster 1689213308.138468 mgr.a (mgr.14152) 837 : cluster 0 pgmap v718: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:11.151 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:10 smithi022 bash[26979]: cluster 1689213310.1389697 mgr.a (mgr.14152) 838 : cluster 0 pgmap v719: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:11.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:10 smithi154 bash[27744]: cluster 1689213310.1389697 mgr.a (mgr.14152) 838 : cluster 0 pgmap v719: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:11.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:10 smithi137 bash[27262]: cluster 1689213310.1389697 mgr.a (mgr.14152) 838 : cluster 0 pgmap v719: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:11.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:10 smithi103 bash[27315]: cluster 1689213310.1389697 mgr.a (mgr.14152) 838 : cluster 0 pgmap v719: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:11.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:10 smithi084 bash[27323]: cluster 1689213310.1389697 mgr.a (mgr.14152) 838 : cluster 0 pgmap v719: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:12.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:55:12.968 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:55:13.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:13 smithi022 bash[26979]: cluster 1689213312.1394408 mgr.a (mgr.14152) 839 : cluster 0 pgmap v720: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:13.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:13 smithi022 bash[26979]: audit 1689213312.229257 mon.a (mon.0) 1084 : audit 0 from='client.? 172.21.15.22:0/3681730413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:13.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:13 smithi154 bash[27744]: cluster 1689213312.1394408 mgr.a (mgr.14152) 839 : cluster 0 pgmap v720: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:13.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:13 smithi154 bash[27744]: audit 1689213312.229257 mon.a (mon.0) 1084 : audit 0 from='client.? 172.21.15.22:0/3681730413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:13.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:13 smithi137 bash[27262]: cluster 1689213312.1394408 mgr.a (mgr.14152) 839 : cluster 0 pgmap v720: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:13.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:13 smithi137 bash[27262]: audit 1689213312.229257 mon.a (mon.0) 1084 : audit 0 from='client.? 172.21.15.22:0/3681730413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:13.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:13 smithi103 bash[27315]: cluster 1689213312.1394408 mgr.a (mgr.14152) 839 : cluster 0 pgmap v720: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:13.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:13 smithi103 bash[27315]: audit 1689213312.229257 mon.a (mon.0) 1084 : audit 0 from='client.? 172.21.15.22:0/3681730413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:13.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:13 smithi084 bash[27323]: cluster 1689213312.1394408 mgr.a (mgr.14152) 839 : cluster 0 pgmap v720: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:13.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:13 smithi084 bash[27323]: audit 1689213312.229257 mon.a (mon.0) 1084 : audit 0 from='client.? 172.21.15.22:0/3681730413' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:13.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:55:15.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:15 smithi154 bash[27744]: cluster 1689213314.140024 mgr.a (mgr.14152) 840 : cluster 0 pgmap v721: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:15.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:15 smithi137 bash[27262]: cluster 1689213314.140024 mgr.a (mgr.14152) 840 : cluster 0 pgmap v721: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:15.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:15 smithi103 bash[27315]: cluster 1689213314.140024 mgr.a (mgr.14152) 840 : cluster 0 pgmap v721: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:15.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:15 smithi084 bash[27323]: cluster 1689213314.140024 mgr.a (mgr.14152) 840 : cluster 0 pgmap v721: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:15.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:15 smithi022 bash[26979]: cluster 1689213314.140024 mgr.a (mgr.14152) 840 : cluster 0 pgmap v721: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:17.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:17 smithi154 bash[27744]: cluster 1689213316.1405694 mgr.a (mgr.14152) 841 : cluster 0 pgmap v722: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:17.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:17 smithi137 bash[27262]: cluster 1689213316.1405694 mgr.a (mgr.14152) 841 : cluster 0 pgmap v722: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:17.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:17 smithi103 bash[27315]: cluster 1689213316.1405694 mgr.a (mgr.14152) 841 : cluster 0 pgmap v722: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:17.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:17 smithi084 bash[27323]: cluster 1689213316.1405694 mgr.a (mgr.14152) 841 : cluster 0 pgmap v722: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:17.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:17 smithi022 bash[26979]: cluster 1689213316.1405694 mgr.a (mgr.14152) 841 : cluster 0 pgmap v722: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:18.665 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:55:19.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:19 smithi154 bash[27744]: cluster 1689213318.1410673 mgr.a (mgr.14152) 842 : cluster 0 pgmap v723: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:19.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:19 smithi137 bash[27262]: cluster 1689213318.1410673 mgr.a (mgr.14152) 842 : cluster 0 pgmap v723: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:19.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:19 smithi103 bash[27315]: cluster 1689213318.1410673 mgr.a (mgr.14152) 842 : cluster 0 pgmap v723: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:19.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:19 smithi084 bash[27323]: cluster 1689213318.1410673 mgr.a (mgr.14152) 842 : cluster 0 pgmap v723: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:19.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:19 smithi022 bash[26979]: cluster 1689213318.1410673 mgr.a (mgr.14152) 842 : cluster 0 pgmap v723: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:21.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:20 smithi154 bash[27744]: cluster 1689213320.1415865 mgr.a (mgr.14152) 843 : cluster 0 pgmap v724: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:21.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:20 smithi137 bash[27262]: cluster 1689213320.1415865 mgr.a (mgr.14152) 843 : cluster 0 pgmap v724: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:21.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:20 smithi103 bash[27315]: cluster 1689213320.1415865 mgr.a (mgr.14152) 843 : cluster 0 pgmap v724: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:21.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:20 smithi084 bash[27323]: cluster 1689213320.1415865 mgr.a (mgr.14152) 843 : cluster 0 pgmap v724: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:21.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:20 smithi022 bash[26979]: cluster 1689213320.1415865 mgr.a (mgr.14152) 843 : cluster 0 pgmap v724: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:21.922 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:55:22.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:21 smithi154 bash[27744]: audit 1689213321.9375174 mon.a (mon.0) 1085 : audit 0 from='client.? 172.21.15.22:0/3770157803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:22.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:21 smithi137 bash[27262]: audit 1689213321.9375174 mon.a (mon.0) 1085 : audit 0 from='client.? 172.21.15.22:0/3770157803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:22.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:21 smithi103 bash[27315]: audit 1689213321.9375174 mon.a (mon.0) 1085 : audit 0 from='client.? 172.21.15.22:0/3770157803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:22.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:21 smithi084 bash[27323]: audit 1689213321.9375174 mon.a (mon.0) 1085 : audit 0 from='client.? 172.21.15.22:0/3770157803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:22.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:21 smithi022 bash[26979]: audit 1689213321.9375174 mon.a (mon.0) 1085 : audit 0 from='client.? 172.21.15.22:0/3770157803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:22.677 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:55:23.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:22 smithi154 bash[27744]: cluster 1689213322.141983 mgr.a (mgr.14152) 844 : cluster 0 pgmap v725: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:23.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:22 smithi137 bash[27262]: cluster 1689213322.141983 mgr.a (mgr.14152) 844 : cluster 0 pgmap v725: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:23.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:22 smithi103 bash[27315]: cluster 1689213322.141983 mgr.a (mgr.14152) 844 : cluster 0 pgmap v725: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:23.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:22 smithi084 bash[27323]: cluster 1689213322.141983 mgr.a (mgr.14152) 844 : cluster 0 pgmap v725: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:23.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:22 smithi022 bash[26979]: cluster 1689213322.141983 mgr.a (mgr.14152) 844 : cluster 0 pgmap v725: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:23.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:55:25.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:25 smithi154 bash[27744]: cluster 1689213324.1424906 mgr.a (mgr.14152) 845 : cluster 0 pgmap v726: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:25.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:25 smithi137 bash[27262]: cluster 1689213324.1424906 mgr.a (mgr.14152) 845 : cluster 0 pgmap v726: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:25.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:25 smithi103 bash[27315]: cluster 1689213324.1424906 mgr.a (mgr.14152) 845 : cluster 0 pgmap v726: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:25.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:25 smithi084 bash[27323]: cluster 1689213324.1424906 mgr.a (mgr.14152) 845 : cluster 0 pgmap v726: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:25.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:25 smithi022 bash[26979]: cluster 1689213324.1424906 mgr.a (mgr.14152) 845 : cluster 0 pgmap v726: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:27.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:27 smithi154 bash[27744]: cluster 1689213326.1429987 mgr.a (mgr.14152) 846 : cluster 0 pgmap v727: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:27.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:27 smithi137 bash[27262]: cluster 1689213326.1429987 mgr.a (mgr.14152) 846 : cluster 0 pgmap v727: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:27.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:27 smithi103 bash[27315]: cluster 1689213326.1429987 mgr.a (mgr.14152) 846 : cluster 0 pgmap v727: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:27.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:27 smithi084 bash[27323]: cluster 1689213326.1429987 mgr.a (mgr.14152) 846 : cluster 0 pgmap v727: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:27.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:27 smithi022 bash[26979]: cluster 1689213326.1429987 mgr.a (mgr.14152) 846 : cluster 0 pgmap v727: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:55:29.443 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:29 smithi022 bash[26979]: cluster 1689213328.143488 mgr.a (mgr.14152) 847 : cluster 0 pgmap v728: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:29.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:29 smithi154 bash[27744]: cluster 1689213328.143488 mgr.a (mgr.14152) 847 : cluster 0 pgmap v728: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:29.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:29 smithi137 bash[27262]: cluster 1689213328.143488 mgr.a (mgr.14152) 847 : cluster 0 pgmap v728: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:29.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:29 smithi103 bash[27315]: cluster 1689213328.143488 mgr.a (mgr.14152) 847 : cluster 0 pgmap v728: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:29.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:29 smithi084 bash[27323]: cluster 1689213328.143488 mgr.a (mgr.14152) 847 : cluster 0 pgmap v728: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:31.235 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:30 smithi022 bash[26979]: cluster 1689213330.1440191 mgr.a (mgr.14152) 848 : cluster 0 pgmap v729: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:31.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:30 smithi154 bash[27744]: cluster 1689213330.1440191 mgr.a (mgr.14152) 848 : cluster 0 pgmap v729: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:31.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:30 smithi137 bash[27262]: cluster 1689213330.1440191 mgr.a (mgr.14152) 848 : cluster 0 pgmap v729: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:31.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:30 smithi103 bash[27315]: cluster 1689213330.1440191 mgr.a (mgr.14152) 848 : cluster 0 pgmap v729: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:31.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:30 smithi084 bash[27323]: cluster 1689213330.1440191 mgr.a (mgr.14152) 848 : cluster 0 pgmap v729: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:31.709 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:55:32.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:31 smithi022 bash[26979]: audit 1689213331.7237737 mon.a (mon.0) 1086 : audit 0 from='client.? 172.21.15.22:0/2576937777' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:32.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:31 smithi154 bash[27744]: audit 1689213331.7237737 mon.a (mon.0) 1086 : audit 0 from='client.? 172.21.15.22:0/2576937777' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:32.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:31 smithi137 bash[27262]: audit 1689213331.7237737 mon.a (mon.0) 1086 : audit 0 from='client.? 172.21.15.22:0/2576937777' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:32.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:31 smithi103 bash[27315]: audit 1689213331.7237737 mon.a (mon.0) 1086 : audit 0 from='client.? 172.21.15.22:0/2576937777' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:32.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:31 smithi084 bash[27323]: audit 1689213331.7237737 mon.a (mon.0) 1086 : audit 0 from='client.? 172.21.15.22:0/2576937777' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:32.422 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:55:33.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:32 smithi154 bash[27744]: cluster 1689213332.1445467 mgr.a (mgr.14152) 849 : cluster 0 pgmap v730: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:33.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:32 smithi137 bash[27262]: cluster 1689213332.1445467 mgr.a (mgr.14152) 849 : cluster 0 pgmap v730: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:33.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:32 smithi103 bash[27315]: cluster 1689213332.1445467 mgr.a (mgr.14152) 849 : cluster 0 pgmap v730: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:33.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:32 smithi084 bash[27323]: cluster 1689213332.1445467 mgr.a (mgr.14152) 849 : cluster 0 pgmap v730: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:33.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:32 smithi022 bash[26979]: cluster 1689213332.1445467 mgr.a (mgr.14152) 849 : cluster 0 pgmap v730: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:33.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:55:35.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:35 smithi154 bash[27744]: cluster 1689213334.1451616 mgr.a (mgr.14152) 850 : cluster 0 pgmap v731: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:35.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:35 smithi137 bash[27262]: cluster 1689213334.1451616 mgr.a (mgr.14152) 850 : cluster 0 pgmap v731: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:35.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:35 smithi103 bash[27315]: cluster 1689213334.1451616 mgr.a (mgr.14152) 850 : cluster 0 pgmap v731: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:35.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:35 smithi084 bash[27323]: cluster 1689213334.1451616 mgr.a (mgr.14152) 850 : cluster 0 pgmap v731: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:35.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:35 smithi022 bash[26979]: cluster 1689213334.1451616 mgr.a (mgr.14152) 850 : cluster 0 pgmap v731: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:37.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:37 smithi154 bash[27744]: cluster 1689213336.1456933 mgr.a (mgr.14152) 851 : cluster 0 pgmap v732: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:37.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:37 smithi137 bash[27262]: cluster 1689213336.1456933 mgr.a (mgr.14152) 851 : cluster 0 pgmap v732: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:37.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:37 smithi103 bash[27315]: cluster 1689213336.1456933 mgr.a (mgr.14152) 851 : cluster 0 pgmap v732: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:37.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:37 smithi084 bash[27323]: cluster 1689213336.1456933 mgr.a (mgr.14152) 851 : cluster 0 pgmap v732: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:37.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:37 smithi022 bash[26979]: cluster 1689213336.1456933 mgr.a (mgr.14152) 851 : cluster 0 pgmap v732: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:38.128 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:55:39.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:39 smithi022 bash[26979]: cluster 1689213338.146164 mgr.a (mgr.14152) 852 : cluster 0 pgmap v733: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:39.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:39 smithi154 bash[27744]: cluster 1689213338.146164 mgr.a (mgr.14152) 852 : cluster 0 pgmap v733: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:39.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:39 smithi137 bash[27262]: cluster 1689213338.146164 mgr.a (mgr.14152) 852 : cluster 0 pgmap v733: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:39.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:39 smithi103 bash[27315]: cluster 1689213338.146164 mgr.a (mgr.14152) 852 : cluster 0 pgmap v733: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:39.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:39 smithi084 bash[27323]: cluster 1689213338.146164 mgr.a (mgr.14152) 852 : cluster 0 pgmap v733: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:41.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:40 smithi154 bash[27744]: cluster 1689213340.146651 mgr.a (mgr.14152) 853 : cluster 0 pgmap v734: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:41.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:40 smithi137 bash[27262]: cluster 1689213340.146651 mgr.a (mgr.14152) 853 : cluster 0 pgmap v734: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:41.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:40 smithi103 bash[27315]: cluster 1689213340.146651 mgr.a (mgr.14152) 853 : cluster 0 pgmap v734: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:41.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:40 smithi084 bash[27323]: cluster 1689213340.146651 mgr.a (mgr.14152) 853 : cluster 0 pgmap v734: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:41.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:40 smithi022 bash[26979]: cluster 1689213340.146651 mgr.a (mgr.14152) 853 : cluster 0 pgmap v734: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:41.487 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:55:42.150 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:41 smithi022 bash[26979]: audit 1689213341.5025544 mon.a (mon.0) 1087 : audit 0 from='client.? 172.21.15.22:0/2851642015' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:42.240 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:55:42.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:41 smithi154 bash[27744]: audit 1689213341.5025544 mon.a (mon.0) 1087 : audit 0 from='client.? 172.21.15.22:0/2851642015' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:42.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:41 smithi137 bash[27262]: audit 1689213341.5025544 mon.a (mon.0) 1087 : audit 0 from='client.? 172.21.15.22:0/2851642015' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:42.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:41 smithi103 bash[27315]: audit 1689213341.5025544 mon.a (mon.0) 1087 : audit 0 from='client.? 172.21.15.22:0/2851642015' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:42.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:41 smithi084 bash[27323]: audit 1689213341.5025544 mon.a (mon.0) 1087 : audit 0 from='client.? 172.21.15.22:0/2851642015' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:43.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:55:43.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:42 smithi154 bash[27744]: cluster 1689213342.147213 mgr.a (mgr.14152) 854 : cluster 0 pgmap v735: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:43.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:42 smithi022 bash[26979]: cluster 1689213342.147213 mgr.a (mgr.14152) 854 : cluster 0 pgmap v735: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:43.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:42 smithi137 bash[27262]: cluster 1689213342.147213 mgr.a (mgr.14152) 854 : cluster 0 pgmap v735: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:43.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:42 smithi103 bash[27315]: cluster 1689213342.147213 mgr.a (mgr.14152) 854 : cluster 0 pgmap v735: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:43.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:42 smithi084 bash[27323]: cluster 1689213342.147213 mgr.a (mgr.14152) 854 : cluster 0 pgmap v735: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:45.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:45 smithi154 bash[27744]: cluster 1689213344.1476786 mgr.a (mgr.14152) 855 : cluster 0 pgmap v736: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:45.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:45 smithi137 bash[27262]: cluster 1689213344.1476786 mgr.a (mgr.14152) 855 : cluster 0 pgmap v736: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:45.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:45 smithi103 bash[27315]: cluster 1689213344.1476786 mgr.a (mgr.14152) 855 : cluster 0 pgmap v736: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:45.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:45 smithi084 bash[27323]: cluster 1689213344.1476786 mgr.a (mgr.14152) 855 : cluster 0 pgmap v736: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:45.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:45 smithi022 bash[26979]: cluster 1689213344.1476786 mgr.a (mgr.14152) 855 : cluster 0 pgmap v736: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:47.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:47 smithi154 bash[27744]: cluster 1689213346.1481838 mgr.a (mgr.14152) 856 : cluster 0 pgmap v737: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:47.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:47 smithi137 bash[27262]: cluster 1689213346.1481838 mgr.a (mgr.14152) 856 : cluster 0 pgmap v737: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:47.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:47 smithi103 bash[27315]: cluster 1689213346.1481838 mgr.a (mgr.14152) 856 : cluster 0 pgmap v737: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:47.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:47 smithi084 bash[27323]: cluster 1689213346.1481838 mgr.a (mgr.14152) 856 : cluster 0 pgmap v737: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:47.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:47 smithi022 bash[26979]: cluster 1689213346.1481838 mgr.a (mgr.14152) 856 : cluster 0 pgmap v737: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:47.942 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:55:49.223 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:49 smithi022 bash[26979]: cluster 1689213348.1486933 mgr.a (mgr.14152) 857 : cluster 0 pgmap v738: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:49.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:49 smithi154 bash[27744]: cluster 1689213348.1486933 mgr.a (mgr.14152) 857 : cluster 0 pgmap v738: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:49.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:49 smithi137 bash[27262]: cluster 1689213348.1486933 mgr.a (mgr.14152) 857 : cluster 0 pgmap v738: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:49.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:49 smithi103 bash[27315]: cluster 1689213348.1486933 mgr.a (mgr.14152) 857 : cluster 0 pgmap v738: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:49.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:49 smithi084 bash[27323]: cluster 1689213348.1486933 mgr.a (mgr.14152) 857 : cluster 0 pgmap v738: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:51.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:50 smithi022 bash[26979]: cluster 1689213350.1492224 mgr.a (mgr.14152) 858 : cluster 0 pgmap v739: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:51.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:50 smithi154 bash[27744]: cluster 1689213350.1492224 mgr.a (mgr.14152) 858 : cluster 0 pgmap v739: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:51.250 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:55:51.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:50 smithi137 bash[27262]: cluster 1689213350.1492224 mgr.a (mgr.14152) 858 : cluster 0 pgmap v739: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:51.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:50 smithi103 bash[27315]: cluster 1689213350.1492224 mgr.a (mgr.14152) 858 : cluster 0 pgmap v739: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:51.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:50 smithi084 bash[27323]: cluster 1689213350.1492224 mgr.a (mgr.14152) 858 : cluster 0 pgmap v739: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:51.985 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:55:52.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:51 smithi154 bash[27744]: audit 1689213351.2735145 mon.e (mon.1) 17 : audit 0 from='client.? 172.21.15.22:0/3752178750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:52.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:51 smithi137 bash[27262]: audit 1689213351.2735145 mon.e (mon.1) 17 : audit 0 from='client.? 172.21.15.22:0/3752178750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:52.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:51 smithi103 bash[27315]: audit 1689213351.2735145 mon.e (mon.1) 17 : audit 0 from='client.? 172.21.15.22:0/3752178750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:52.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:51 smithi084 bash[27323]: audit 1689213351.2735145 mon.e (mon.1) 17 : audit 0 from='client.? 172.21.15.22:0/3752178750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:52.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:51 smithi022 bash[26979]: audit 1689213351.2735145 mon.e (mon.1) 17 : audit 0 from='client.? 172.21.15.22:0/3752178750' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:55:52.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:55:53.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: cluster 1689213352.1497762 mgr.a (mgr.14152) 859 : cluster 0 pgmap v740: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:53.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.3092003 mon.a (mon.0) 1088 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:55:53.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.7409732 mon.a (mon.0) 1089 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.7475827 mon.a (mon.0) 1090 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.7519753 mon.a (mon.0) 1091 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.758167 mon.a (mon.0) 1092 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.766471 mon.a (mon.0) 1093 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.247 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:52 smithi154 bash[27744]: audit 1689213352.7738416 mon.a (mon.0) 1094 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: cluster 1689213352.1497762 mgr.a (mgr.14152) 859 : cluster 0 pgmap v740: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:53.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.3092003 mon.a (mon.0) 1088 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:55:53.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.7409732 mon.a (mon.0) 1089 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.7475827 mon.a (mon.0) 1090 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.7519753 mon.a (mon.0) 1091 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.758167 mon.a (mon.0) 1092 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.766471 mon.a (mon.0) 1093 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.293 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:52 smithi137 bash[27262]: audit 1689213352.7738416 mon.a (mon.0) 1094 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: cluster 1689213352.1497762 mgr.a (mgr.14152) 859 : cluster 0 pgmap v740: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:53.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.3092003 mon.a (mon.0) 1088 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:55:53.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.7409732 mon.a (mon.0) 1089 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.7475827 mon.a (mon.0) 1090 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.7519753 mon.a (mon.0) 1091 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.758167 mon.a (mon.0) 1092 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.766471 mon.a (mon.0) 1093 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.345 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:52 smithi103 bash[27315]: audit 1689213352.7738416 mon.a (mon.0) 1094 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: cluster 1689213352.1497762 mgr.a (mgr.14152) 859 : cluster 0 pgmap v740: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:53.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.3092003 mon.a (mon.0) 1088 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:55:53.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.7409732 mon.a (mon.0) 1089 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.7475827 mon.a (mon.0) 1090 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.7519753 mon.a (mon.0) 1091 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.758167 mon.a (mon.0) 1092 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.766471 mon.a (mon.0) 1093 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:52 smithi084 bash[27323]: audit 1689213352.7738416 mon.a (mon.0) 1094 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: cluster 1689213352.1497762 mgr.a (mgr.14152) 859 : cluster 0 pgmap v740: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:53.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.3092003 mon.a (mon.0) 1088 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:55:53.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.7409732 mon.a (mon.0) 1089 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.7475827 mon.a (mon.0) 1090 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.7519753 mon.a (mon.0) 1091 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.758167 mon.a (mon.0) 1092 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.766471 mon.a (mon.0) 1093 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:53.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:52 smithi022 bash[26979]: audit 1689213352.7738416 mon.a (mon.0) 1094 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:55.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:55 smithi154 bash[27744]: cluster 1689213354.1502547 mgr.a (mgr.14152) 860 : cluster 0 pgmap v741: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:55.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:55 smithi137 bash[27262]: cluster 1689213354.1502547 mgr.a (mgr.14152) 860 : cluster 0 pgmap v741: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:55.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:55 smithi103 bash[27315]: cluster 1689213354.1502547 mgr.a (mgr.14152) 860 : cluster 0 pgmap v741: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:55.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:55 smithi084 bash[27323]: cluster 1689213354.1502547 mgr.a (mgr.14152) 860 : cluster 0 pgmap v741: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:55.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:55 smithi022 bash[26979]: cluster 1689213354.1502547 mgr.a (mgr.14152) 860 : cluster 0 pgmap v741: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:57.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:57 smithi154 bash[27744]: cluster 1689213356.1507688 mgr.a (mgr.14152) 861 : cluster 0 pgmap v742: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:57.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:57 smithi137 bash[27262]: cluster 1689213356.1507688 mgr.a (mgr.14152) 861 : cluster 0 pgmap v742: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:57.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:57 smithi103 bash[27315]: cluster 1689213356.1507688 mgr.a (mgr.14152) 861 : cluster 0 pgmap v742: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:57.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:57 smithi084 bash[27323]: cluster 1689213356.1507688 mgr.a (mgr.14152) 861 : cluster 0 pgmap v742: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:57.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:57 smithi022 bash[26979]: cluster 1689213356.1507688 mgr.a (mgr.14152) 861 : cluster 0 pgmap v742: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:57.677 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:55:59.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: cluster 1689213358.1512702 mgr.a (mgr.14152) 862 : cluster 0 pgmap v743: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:59.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.383531 mon.a (mon.0) 1095 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.3909798 mon.a (mon.0) 1096 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.860005 mon.a (mon.0) 1097 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.8616006 mon.a (mon.0) 1098 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.8630934 mon.a (mon.0) 1099 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.8663137 mon.a (mon.0) 1100 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:55:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.867905 mon.a (mon.0) 1101 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:55:59.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:55:59 smithi022 bash[26979]: audit 1689213358.8769774 mon.a (mon.0) 1102 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: cluster 1689213358.1512702 mgr.a (mgr.14152) 862 : cluster 0 pgmap v743: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:59.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.383531 mon.a (mon.0) 1095 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.3909798 mon.a (mon.0) 1096 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.860005 mon.a (mon.0) 1097 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.8616006 mon.a (mon.0) 1098 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.8630934 mon.a (mon.0) 1099 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.8663137 mon.a (mon.0) 1100 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:55:59.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.867905 mon.a (mon.0) 1101 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:55:59.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:55:59 smithi154 bash[27744]: audit 1689213358.8769774 mon.a (mon.0) 1102 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: cluster 1689213358.1512702 mgr.a (mgr.14152) 862 : cluster 0 pgmap v743: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:59.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.383531 mon.a (mon.0) 1095 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.3909798 mon.a (mon.0) 1096 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.860005 mon.a (mon.0) 1097 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.8616006 mon.a (mon.0) 1098 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.8630934 mon.a (mon.0) 1099 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.8663137 mon.a (mon.0) 1100 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:55:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.867905 mon.a (mon.0) 1101 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:55:59.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:55:59 smithi137 bash[27262]: audit 1689213358.8769774 mon.a (mon.0) 1102 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: cluster 1689213358.1512702 mgr.a (mgr.14152) 862 : cluster 0 pgmap v743: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:59.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.383531 mon.a (mon.0) 1095 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.3909798 mon.a (mon.0) 1096 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.860005 mon.a (mon.0) 1097 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.8616006 mon.a (mon.0) 1098 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.8630934 mon.a (mon.0) 1099 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.8663137 mon.a (mon.0) 1100 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:55:59.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.867905 mon.a (mon.0) 1101 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:55:59.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:55:59 smithi103 bash[27315]: audit 1689213358.8769774 mon.a (mon.0) 1102 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: cluster 1689213358.1512702 mgr.a (mgr.14152) 862 : cluster 0 pgmap v743: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:55:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.383531 mon.a (mon.0) 1095 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.3909798 mon.a (mon.0) 1096 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:55:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.860005 mon.a (mon.0) 1097 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.8616006 mon.a (mon.0) 1098 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.8630934 mon.a (mon.0) 1099 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:55:59.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.8663137 mon.a (mon.0) 1100 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:55:59.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.867905 mon.a (mon.0) 1101 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:55:59.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:55:59 smithi084 bash[27323]: audit 1689213358.8769774 mon.a (mon.0) 1102 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:56:00.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:00 smithi154 bash[27744]: cephadm 1689213358.8641932 mgr.a (mgr.14152) 863 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:56:00.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:00 smithi154 bash[27744]: cluster 1689213358.8704326 mgr.a (mgr.14152) 864 : cluster 0 pgmap v744: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:00 smithi154 bash[27744]: cluster 1689213358.8705795 mgr.a (mgr.14152) 865 : cluster 0 pgmap v745: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:00 smithi154 bash[27744]: cluster 1689213359.3874953 mon.a (mon.0) 1103 : cluster 3 Health check update: 14 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:56:00.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:00 smithi137 bash[27262]: cephadm 1689213358.8641932 mgr.a (mgr.14152) 863 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:56:00.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:00 smithi137 bash[27262]: cluster 1689213358.8704326 mgr.a (mgr.14152) 864 : cluster 0 pgmap v744: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:00 smithi137 bash[27262]: cluster 1689213358.8705795 mgr.a (mgr.14152) 865 : cluster 0 pgmap v745: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:00 smithi137 bash[27262]: cluster 1689213359.3874953 mon.a (mon.0) 1103 : cluster 3 Health check update: 14 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:56:00.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:00 smithi103 bash[27315]: cephadm 1689213358.8641932 mgr.a (mgr.14152) 863 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:56:00.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:00 smithi103 bash[27315]: cluster 1689213358.8704326 mgr.a (mgr.14152) 864 : cluster 0 pgmap v744: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:00 smithi103 bash[27315]: cluster 1689213358.8705795 mgr.a (mgr.14152) 865 : cluster 0 pgmap v745: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:00 smithi103 bash[27315]: cluster 1689213359.3874953 mon.a (mon.0) 1103 : cluster 3 Health check update: 14 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:56:00.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:00 smithi022 bash[26979]: cephadm 1689213358.8641932 mgr.a (mgr.14152) 863 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:56:00.620 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:00 smithi022 bash[26979]: cluster 1689213358.8704326 mgr.a (mgr.14152) 864 : cluster 0 pgmap v744: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:00 smithi022 bash[26979]: cluster 1689213358.8705795 mgr.a (mgr.14152) 865 : cluster 0 pgmap v745: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:00 smithi022 bash[26979]: cluster 1689213359.3874953 mon.a (mon.0) 1103 : cluster 3 Health check update: 14 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:56:00.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:00 smithi084 bash[27323]: cephadm 1689213358.8641932 mgr.a (mgr.14152) 863 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T01:56:00.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:00 smithi084 bash[27323]: cluster 1689213358.8704326 mgr.a (mgr.14152) 864 : cluster 0 pgmap v744: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:00 smithi084 bash[27323]: cluster 1689213358.8705795 mgr.a (mgr.14152) 865 : cluster 0 pgmap v745: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:00.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:00 smithi084 bash[27323]: cluster 1689213359.3874953 mon.a (mon.0) 1103 : cluster 3 Health check update: 14 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T01:56:01.094 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:56:01.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:01 smithi154 bash[27744]: audit 1689213361.1138575 mon.b (mon.4) 22 : audit 0 from='client.? 172.21.15.22:0/519508166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:01.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:01 smithi137 bash[27262]: audit 1689213361.1138575 mon.b (mon.4) 22 : audit 0 from='client.? 172.21.15.22:0/519508166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:01.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:01 smithi103 bash[27315]: audit 1689213361.1138575 mon.b (mon.4) 22 : audit 0 from='client.? 172.21.15.22:0/519508166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:01.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:01 smithi084 bash[27323]: audit 1689213361.1138575 mon.b (mon.4) 22 : audit 0 from='client.? 172.21.15.22:0/519508166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:01.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:01 smithi022 bash[26979]: audit 1689213361.1138575 mon.b (mon.4) 22 : audit 0 from='client.? 172.21.15.22:0/519508166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:01.852 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:56:02.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:02 smithi154 bash[27744]: cluster 1689213360.8710911 mgr.a (mgr.14152) 866 : cluster 0 pgmap v746: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:02.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:02 smithi137 bash[27262]: cluster 1689213360.8710911 mgr.a (mgr.14152) 866 : cluster 0 pgmap v746: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:02.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:02 smithi103 bash[27315]: cluster 1689213360.8710911 mgr.a (mgr.14152) 866 : cluster 0 pgmap v746: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:02.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:02 smithi084 bash[27323]: cluster 1689213360.8710911 mgr.a (mgr.14152) 866 : cluster 0 pgmap v746: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:02.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:02 smithi022 bash[26979]: cluster 1689213360.8710911 mgr.a (mgr.14152) 866 : cluster 0 pgmap v746: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:02.853 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:56:04.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:04 smithi154 bash[27744]: cluster 1689213362.8718245 mgr.a (mgr.14152) 867 : cluster 0 pgmap v747: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:04.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:04 smithi137 bash[27262]: cluster 1689213362.8718245 mgr.a (mgr.14152) 867 : cluster 0 pgmap v747: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:04.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:04 smithi103 bash[27315]: cluster 1689213362.8718245 mgr.a (mgr.14152) 867 : cluster 0 pgmap v747: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:04.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:04 smithi084 bash[27323]: cluster 1689213362.8718245 mgr.a (mgr.14152) 867 : cluster 0 pgmap v747: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:04.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:04 smithi022 bash[26979]: cluster 1689213362.8718245 mgr.a (mgr.14152) 867 : cluster 0 pgmap v747: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:06.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:06 smithi154 bash[27744]: cluster 1689213364.8724067 mgr.a (mgr.14152) 868 : cluster 0 pgmap v748: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:06.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:06 smithi137 bash[27262]: cluster 1689213364.8724067 mgr.a (mgr.14152) 868 : cluster 0 pgmap v748: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:06.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:06 smithi103 bash[27315]: cluster 1689213364.8724067 mgr.a (mgr.14152) 868 : cluster 0 pgmap v748: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:06.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:06 smithi084 bash[27323]: cluster 1689213364.8724067 mgr.a (mgr.14152) 868 : cluster 0 pgmap v748: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:06.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:06 smithi022 bash[26979]: cluster 1689213364.8724067 mgr.a (mgr.14152) 868 : cluster 0 pgmap v748: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:07.549 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:56:08.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:08 smithi154 bash[27744]: cluster 1689213366.872936 mgr.a (mgr.14152) 869 : cluster 0 pgmap v749: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:08.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:08 smithi137 bash[27262]: cluster 1689213366.872936 mgr.a (mgr.14152) 869 : cluster 0 pgmap v749: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:08.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:08 smithi103 bash[27315]: cluster 1689213366.872936 mgr.a (mgr.14152) 869 : cluster 0 pgmap v749: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:08.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:08 smithi084 bash[27323]: cluster 1689213366.872936 mgr.a (mgr.14152) 869 : cluster 0 pgmap v749: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:08.637 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:08 smithi022 bash[26979]: cluster 1689213366.872936 mgr.a (mgr.14152) 869 : cluster 0 pgmap v749: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:10.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:10 smithi154 bash[27744]: cluster 1689213368.8734972 mgr.a (mgr.14152) 870 : cluster 0 pgmap v750: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:10.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:10 smithi022 bash[26979]: cluster 1689213368.8734972 mgr.a (mgr.14152) 870 : cluster 0 pgmap v750: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:10.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:10 smithi137 bash[27262]: cluster 1689213368.8734972 mgr.a (mgr.14152) 870 : cluster 0 pgmap v750: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:10.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:10 smithi103 bash[27315]: cluster 1689213368.8734972 mgr.a (mgr.14152) 870 : cluster 0 pgmap v750: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:10.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:10 smithi084 bash[27323]: cluster 1689213368.8734972 mgr.a (mgr.14152) 870 : cluster 0 pgmap v750: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:10.926 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:56:11.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:11 smithi022 bash[26979]: audit 1689213370.942702 mon.a (mon.0) 1104 : audit 0 from='client.? 172.21.15.22:0/1895373558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:11.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:11 smithi154 bash[27744]: audit 1689213370.942702 mon.a (mon.0) 1104 : audit 0 from='client.? 172.21.15.22:0/1895373558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:11.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:11 smithi137 bash[27262]: audit 1689213370.942702 mon.a (mon.0) 1104 : audit 0 from='client.? 172.21.15.22:0/1895373558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:11.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:11 smithi103 bash[27315]: audit 1689213370.942702 mon.a (mon.0) 1104 : audit 0 from='client.? 172.21.15.22:0/1895373558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:11.601 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:56:11.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:11 smithi084 bash[27323]: audit 1689213370.942702 mon.a (mon.0) 1104 : audit 0 from='client.? 172.21.15.22:0/1895373558' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:12.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:12 smithi154 bash[27744]: cluster 1689213370.874006 mgr.a (mgr.14152) 871 : cluster 0 pgmap v751: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:12.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:12 smithi137 bash[27262]: cluster 1689213370.874006 mgr.a (mgr.14152) 871 : cluster 0 pgmap v751: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:12.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:12 smithi103 bash[27315]: cluster 1689213370.874006 mgr.a (mgr.14152) 871 : cluster 0 pgmap v751: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:12.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:56:12.615 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:12 smithi022 bash[26979]: cluster 1689213370.874006 mgr.a (mgr.14152) 871 : cluster 0 pgmap v751: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:12.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:12 smithi084 bash[27323]: cluster 1689213370.874006 mgr.a (mgr.14152) 871 : cluster 0 pgmap v751: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:14.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:14 smithi154 bash[27744]: cluster 1689213372.874536 mgr.a (mgr.14152) 872 : cluster 0 pgmap v752: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:14.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:14 smithi137 bash[27262]: cluster 1689213372.874536 mgr.a (mgr.14152) 872 : cluster 0 pgmap v752: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:14.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:14 smithi103 bash[27315]: cluster 1689213372.874536 mgr.a (mgr.14152) 872 : cluster 0 pgmap v752: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:14.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:14 smithi084 bash[27323]: cluster 1689213372.874536 mgr.a (mgr.14152) 872 : cluster 0 pgmap v752: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:14.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:14 smithi022 bash[26979]: cluster 1689213372.874536 mgr.a (mgr.14152) 872 : cluster 0 pgmap v752: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:16.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:16 smithi137 bash[27262]: cluster 1689213374.8750708 mgr.a (mgr.14152) 873 : cluster 0 pgmap v753: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:16.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:16 smithi103 bash[27315]: cluster 1689213374.8750708 mgr.a (mgr.14152) 873 : cluster 0 pgmap v753: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:16.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:16 smithi084 bash[27323]: cluster 1689213374.8750708 mgr.a (mgr.14152) 873 : cluster 0 pgmap v753: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:16.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:16 smithi022 bash[26979]: cluster 1689213374.8750708 mgr.a (mgr.14152) 873 : cluster 0 pgmap v753: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:16.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:16 smithi154 bash[27744]: cluster 1689213374.8750708 mgr.a (mgr.14152) 873 : cluster 0 pgmap v753: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:56:18.525 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:18 smithi022 bash[26979]: cluster 1689213376.875597 mgr.a (mgr.14152) 874 : cluster 0 pgmap v754: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:18.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:18 smithi137 bash[27262]: cluster 1689213376.875597 mgr.a (mgr.14152) 874 : cluster 0 pgmap v754: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:18.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:18 smithi103 bash[27315]: cluster 1689213376.875597 mgr.a (mgr.14152) 874 : cluster 0 pgmap v754: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:18.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:18 smithi084 bash[27323]: cluster 1689213376.875597 mgr.a (mgr.14152) 874 : cluster 0 pgmap v754: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:18.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:18 smithi154 bash[27744]: cluster 1689213376.875597 mgr.a (mgr.14152) 874 : cluster 0 pgmap v754: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:20.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:20 smithi022 bash[26979]: cluster 1689213378.876244 mgr.a (mgr.14152) 875 : cluster 0 pgmap v755: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:20.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:20 smithi137 bash[27262]: cluster 1689213378.876244 mgr.a (mgr.14152) 875 : cluster 0 pgmap v755: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:20.557 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:56:20.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:20 smithi103 bash[27315]: cluster 1689213378.876244 mgr.a (mgr.14152) 875 : cluster 0 pgmap v755: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:20.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:20 smithi084 bash[27323]: cluster 1689213378.876244 mgr.a (mgr.14152) 875 : cluster 0 pgmap v755: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:20.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:20 smithi154 bash[27744]: cluster 1689213378.876244 mgr.a (mgr.14152) 875 : cluster 0 pgmap v755: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:21.308 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:56:21.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:21 smithi137 bash[27262]: audit 1689213380.5768857 mon.b (mon.4) 23 : audit 0 from='client.? 172.21.15.22:0/2067800632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:21.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:21 smithi103 bash[27315]: audit 1689213380.5768857 mon.b (mon.4) 23 : audit 0 from='client.? 172.21.15.22:0/2067800632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:21.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:21 smithi084 bash[27323]: audit 1689213380.5768857 mon.b (mon.4) 23 : audit 0 from='client.? 172.21.15.22:0/2067800632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:21.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:21 smithi022 bash[26979]: audit 1689213380.5768857 mon.b (mon.4) 23 : audit 0 from='client.? 172.21.15.22:0/2067800632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:21.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:21 smithi154 bash[27744]: audit 1689213380.5768857 mon.b (mon.4) 23 : audit 0 from='client.? 172.21.15.22:0/2067800632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:22.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:56:22.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:22 smithi137 bash[27262]: cluster 1689213380.8767595 mgr.a (mgr.14152) 876 : cluster 0 pgmap v756: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:22.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:22 smithi103 bash[27315]: cluster 1689213380.8767595 mgr.a (mgr.14152) 876 : cluster 0 pgmap v756: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:22.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:22 smithi084 bash[27323]: cluster 1689213380.8767595 mgr.a (mgr.14152) 876 : cluster 0 pgmap v756: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:22.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:22 smithi022 bash[26979]: cluster 1689213380.8767595 mgr.a (mgr.14152) 876 : cluster 0 pgmap v756: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:22.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:22 smithi154 bash[27744]: cluster 1689213380.8767595 mgr.a (mgr.14152) 876 : cluster 0 pgmap v756: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:24.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:24 smithi137 bash[27262]: cluster 1689213382.8772573 mgr.a (mgr.14152) 877 : cluster 0 pgmap v757: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:24.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:24 smithi103 bash[27315]: cluster 1689213382.8772573 mgr.a (mgr.14152) 877 : cluster 0 pgmap v757: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:24.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:24 smithi084 bash[27323]: cluster 1689213382.8772573 mgr.a (mgr.14152) 877 : cluster 0 pgmap v757: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:24.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:24 smithi022 bash[26979]: cluster 1689213382.8772573 mgr.a (mgr.14152) 877 : cluster 0 pgmap v757: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:24.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:24 smithi154 bash[27744]: cluster 1689213382.8772573 mgr.a (mgr.14152) 877 : cluster 0 pgmap v757: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:26.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:26 smithi137 bash[27262]: cluster 1689213384.8777654 mgr.a (mgr.14152) 878 : cluster 0 pgmap v758: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:26.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:26 smithi103 bash[27315]: cluster 1689213384.8777654 mgr.a (mgr.14152) 878 : cluster 0 pgmap v758: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:26.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:26 smithi084 bash[27323]: cluster 1689213384.8777654 mgr.a (mgr.14152) 878 : cluster 0 pgmap v758: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:26.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:26 smithi022 bash[26979]: cluster 1689213384.8777654 mgr.a (mgr.14152) 878 : cluster 0 pgmap v758: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:26.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:26 smithi154 bash[27744]: cluster 1689213384.8777654 mgr.a (mgr.14152) 878 : cluster 0 pgmap v758: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:27.008 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:56:28.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:28 smithi137 bash[27262]: cluster 1689213386.8782752 mgr.a (mgr.14152) 879 : cluster 0 pgmap v759: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:28.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:28 smithi103 bash[27315]: cluster 1689213386.8782752 mgr.a (mgr.14152) 879 : cluster 0 pgmap v759: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:28.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:28 smithi084 bash[27323]: cluster 1689213386.8782752 mgr.a (mgr.14152) 879 : cluster 0 pgmap v759: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:28.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:28 smithi022 bash[26979]: cluster 1689213386.8782752 mgr.a (mgr.14152) 879 : cluster 0 pgmap v759: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:28.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:28 smithi154 bash[27744]: cluster 1689213386.8782752 mgr.a (mgr.14152) 879 : cluster 0 pgmap v759: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:30.291 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:56:30.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:30 smithi137 bash[27262]: cluster 1689213388.8786762 mgr.a (mgr.14152) 880 : cluster 0 pgmap v760: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:30.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:30 smithi103 bash[27315]: cluster 1689213388.8786762 mgr.a (mgr.14152) 880 : cluster 0 pgmap v760: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:30.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:30 smithi084 bash[27323]: cluster 1689213388.8786762 mgr.a (mgr.14152) 880 : cluster 0 pgmap v760: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:30.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:30 smithi022 bash[26979]: cluster 1689213388.8786762 mgr.a (mgr.14152) 880 : cluster 0 pgmap v760: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:30.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:30 smithi154 bash[27744]: cluster 1689213388.8786762 mgr.a (mgr.14152) 880 : cluster 0 pgmap v760: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:31.058 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:56:31.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:31 smithi022 bash[26979]: audit 1689213390.308399 mon.a (mon.0) 1105 : audit 0 from='client.? 172.21.15.22:0/602637458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:31.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:31 smithi137 bash[27262]: audit 1689213390.308399 mon.a (mon.0) 1105 : audit 0 from='client.? 172.21.15.22:0/602637458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:31.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:31 smithi103 bash[27315]: audit 1689213390.308399 mon.a (mon.0) 1105 : audit 0 from='client.? 172.21.15.22:0/602637458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:31.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:31 smithi084 bash[27323]: audit 1689213390.308399 mon.a (mon.0) 1105 : audit 0 from='client.? 172.21.15.22:0/602637458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:31.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:31 smithi154 bash[27744]: audit 1689213390.308399 mon.a (mon.0) 1105 : audit 0 from='client.? 172.21.15.22:0/602637458' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:32.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:56:32.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:32 smithi022 bash[26979]: cluster 1689213390.8791153 mgr.a (mgr.14152) 881 : cluster 0 pgmap v761: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:32.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:32 smithi103 bash[27315]: cluster 1689213390.8791153 mgr.a (mgr.14152) 881 : cluster 0 pgmap v761: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:32.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:32 smithi084 bash[27323]: cluster 1689213390.8791153 mgr.a (mgr.14152) 881 : cluster 0 pgmap v761: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:32.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:32 smithi154 bash[27744]: cluster 1689213390.8791153 mgr.a (mgr.14152) 881 : cluster 0 pgmap v761: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:32.792 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:32 smithi137 bash[27262]: cluster 1689213390.8791153 mgr.a (mgr.14152) 881 : cluster 0 pgmap v761: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:34.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:34 smithi103 bash[27315]: cluster 1689213392.8795488 mgr.a (mgr.14152) 882 : cluster 0 pgmap v762: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:34.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:34 smithi084 bash[27323]: cluster 1689213392.8795488 mgr.a (mgr.14152) 882 : cluster 0 pgmap v762: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:34.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:34 smithi022 bash[26979]: cluster 1689213392.8795488 mgr.a (mgr.14152) 882 : cluster 0 pgmap v762: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:34.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:34 smithi154 bash[27744]: cluster 1689213392.8795488 mgr.a (mgr.14152) 882 : cluster 0 pgmap v762: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:34.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:34 smithi137 bash[27262]: cluster 1689213392.8795488 mgr.a (mgr.14152) 882 : cluster 0 pgmap v762: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:36.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:36 smithi103 bash[27315]: cluster 1689213394.880155 mgr.a (mgr.14152) 883 : cluster 0 pgmap v763: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:36.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:36 smithi084 bash[27323]: cluster 1689213394.880155 mgr.a (mgr.14152) 883 : cluster 0 pgmap v763: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:36.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:36 smithi022 bash[26979]: cluster 1689213394.880155 mgr.a (mgr.14152) 883 : cluster 0 pgmap v763: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:36.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:36 smithi154 bash[27744]: cluster 1689213394.880155 mgr.a (mgr.14152) 883 : cluster 0 pgmap v763: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:36.755 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:56:36.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:36 smithi137 bash[27262]: cluster 1689213394.880155 mgr.a (mgr.14152) 883 : cluster 0 pgmap v763: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:38.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:38 smithi022 bash[26979]: cluster 1689213396.8807716 mgr.a (mgr.14152) 884 : cluster 0 pgmap v764: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:38.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:38 smithi103 bash[27315]: cluster 1689213396.8807716 mgr.a (mgr.14152) 884 : cluster 0 pgmap v764: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:38.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:38 smithi084 bash[27323]: cluster 1689213396.8807716 mgr.a (mgr.14152) 884 : cluster 0 pgmap v764: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:38.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:38 smithi154 bash[27744]: cluster 1689213396.8807716 mgr.a (mgr.14152) 884 : cluster 0 pgmap v764: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:38.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:38 smithi137 bash[27262]: cluster 1689213396.8807716 mgr.a (mgr.14152) 884 : cluster 0 pgmap v764: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:40.181 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:56:40.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:40 smithi103 bash[27315]: cluster 1689213398.8813388 mgr.a (mgr.14152) 885 : cluster 0 pgmap v765: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:40.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:40 smithi103 bash[27315]: audit 1689213400.200669 mon.b (mon.4) 24 : audit 0 from='client.? 172.21.15.22:0/2796659253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:40.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:40 smithi084 bash[27323]: cluster 1689213398.8813388 mgr.a (mgr.14152) 885 : cluster 0 pgmap v765: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:40.632 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:40 smithi084 bash[27323]: audit 1689213400.200669 mon.b (mon.4) 24 : audit 0 from='client.? 172.21.15.22:0/2796659253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:40.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:40 smithi022 bash[26979]: cluster 1689213398.8813388 mgr.a (mgr.14152) 885 : cluster 0 pgmap v765: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:40.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:40 smithi022 bash[26979]: audit 1689213400.200669 mon.b (mon.4) 24 : audit 0 from='client.? 172.21.15.22:0/2796659253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:40.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:40 smithi154 bash[27744]: cluster 1689213398.8813388 mgr.a (mgr.14152) 885 : cluster 0 pgmap v765: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:40.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:40 smithi154 bash[27744]: audit 1689213400.200669 mon.b (mon.4) 24 : audit 0 from='client.? 172.21.15.22:0/2796659253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:40.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:40 smithi137 bash[27262]: cluster 1689213398.8813388 mgr.a (mgr.14152) 885 : cluster 0 pgmap v765: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:40.792 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:40 smithi137 bash[27262]: audit 1689213400.200669 mon.b (mon.4) 24 : audit 0 from='client.? 172.21.15.22:0/2796659253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:40.939 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:56:41.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:56:42.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:42 smithi103 bash[27315]: cluster 1689213400.881875 mgr.a (mgr.14152) 886 : cluster 0 pgmap v766: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:42.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:42 smithi084 bash[27323]: cluster 1689213400.881875 mgr.a (mgr.14152) 886 : cluster 0 pgmap v766: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:42.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:42 smithi022 bash[26979]: cluster 1689213400.881875 mgr.a (mgr.14152) 886 : cluster 0 pgmap v766: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:42.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:42 smithi154 bash[27744]: cluster 1689213400.881875 mgr.a (mgr.14152) 886 : cluster 0 pgmap v766: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:42.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:42 smithi137 bash[27262]: cluster 1689213400.881875 mgr.a (mgr.14152) 886 : cluster 0 pgmap v766: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:44.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:44 smithi103 bash[27315]: cluster 1689213402.8823934 mgr.a (mgr.14152) 887 : cluster 0 pgmap v767: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:44.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:44 smithi084 bash[27323]: cluster 1689213402.8823934 mgr.a (mgr.14152) 887 : cluster 0 pgmap v767: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:44.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:44 smithi022 bash[26979]: cluster 1689213402.8823934 mgr.a (mgr.14152) 887 : cluster 0 pgmap v767: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:44.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:44 smithi154 bash[27744]: cluster 1689213402.8823934 mgr.a (mgr.14152) 887 : cluster 0 pgmap v767: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:44.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:44 smithi137 bash[27262]: cluster 1689213402.8823934 mgr.a (mgr.14152) 887 : cluster 0 pgmap v767: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:46.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:46 smithi103 bash[27315]: cluster 1689213404.8829672 mgr.a (mgr.14152) 888 : cluster 0 pgmap v768: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:46.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:46 smithi084 bash[27323]: cluster 1689213404.8829672 mgr.a (mgr.14152) 888 : cluster 0 pgmap v768: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:46.637 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:56:46.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:46 smithi022 bash[26979]: cluster 1689213404.8829672 mgr.a (mgr.14152) 888 : cluster 0 pgmap v768: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:46.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:46 smithi154 bash[27744]: cluster 1689213404.8829672 mgr.a (mgr.14152) 888 : cluster 0 pgmap v768: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:46.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:46 smithi137 bash[27262]: cluster 1689213404.8829672 mgr.a (mgr.14152) 888 : cluster 0 pgmap v768: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:48.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:48 smithi103 bash[27315]: cluster 1689213406.8834188 mgr.a (mgr.14152) 889 : cluster 0 pgmap v769: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:48.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:48 smithi084 bash[27323]: cluster 1689213406.8834188 mgr.a (mgr.14152) 889 : cluster 0 pgmap v769: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:48.642 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:48 smithi022 bash[26979]: cluster 1689213406.8834188 mgr.a (mgr.14152) 889 : cluster 0 pgmap v769: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:48.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:48 smithi154 bash[27744]: cluster 1689213406.8834188 mgr.a (mgr.14152) 889 : cluster 0 pgmap v769: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:48.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:48 smithi137 bash[27262]: cluster 1689213406.8834188 mgr.a (mgr.14152) 889 : cluster 0 pgmap v769: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:49.982 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:56:50.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:50 smithi103 bash[27315]: cluster 1689213408.8838751 mgr.a (mgr.14152) 890 : cluster 0 pgmap v770: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:50.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:50 smithi103 bash[27315]: audit 1689213410.0055087 mon.e (mon.1) 18 : audit 0 from='client.? 172.21.15.22:0/3367216533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:50.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:50 smithi084 bash[27323]: cluster 1689213408.8838751 mgr.a (mgr.14152) 890 : cluster 0 pgmap v770: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:50.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:50 smithi084 bash[27323]: audit 1689213410.0055087 mon.e (mon.1) 18 : audit 0 from='client.? 172.21.15.22:0/3367216533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:50.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:50 smithi022 bash[26979]: cluster 1689213408.8838751 mgr.a (mgr.14152) 890 : cluster 0 pgmap v770: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:50.649 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:50 smithi022 bash[26979]: audit 1689213410.0055087 mon.e (mon.1) 18 : audit 0 from='client.? 172.21.15.22:0/3367216533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:50.692 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:56:50.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:50 smithi154 bash[27744]: cluster 1689213408.8838751 mgr.a (mgr.14152) 890 : cluster 0 pgmap v770: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:50.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:50 smithi154 bash[27744]: audit 1689213410.0055087 mon.e (mon.1) 18 : audit 0 from='client.? 172.21.15.22:0/3367216533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:50.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:50 smithi137 bash[27262]: cluster 1689213408.8838751 mgr.a (mgr.14152) 890 : cluster 0 pgmap v770: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:50.792 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:50 smithi137 bash[27262]: audit 1689213410.0055087 mon.e (mon.1) 18 : audit 0 from='client.? 172.21.15.22:0/3367216533' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:56:51.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:56:52.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:52 smithi084 bash[27323]: cluster 1689213410.8845077 mgr.a (mgr.14152) 891 : cluster 0 pgmap v771: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:52.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:52 smithi022 bash[26979]: cluster 1689213410.8845077 mgr.a (mgr.14152) 891 : cluster 0 pgmap v771: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:52.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:52 smithi154 bash[27744]: cluster 1689213410.8845077 mgr.a (mgr.14152) 891 : cluster 0 pgmap v771: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:52.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:52 smithi137 bash[27262]: cluster 1689213410.8845077 mgr.a (mgr.14152) 891 : cluster 0 pgmap v771: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:52.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:52 smithi103 bash[27315]: cluster 1689213410.8845077 mgr.a (mgr.14152) 891 : cluster 0 pgmap v771: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:54.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:54 smithi084 bash[27323]: cluster 1689213412.885021 mgr.a (mgr.14152) 892 : cluster 0 pgmap v772: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:54.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:54 smithi022 bash[26979]: cluster 1689213412.885021 mgr.a (mgr.14152) 892 : cluster 0 pgmap v772: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:54.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:54 smithi154 bash[27744]: cluster 1689213412.885021 mgr.a (mgr.14152) 892 : cluster 0 pgmap v772: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:54.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:54 smithi137 bash[27262]: cluster 1689213412.885021 mgr.a (mgr.14152) 892 : cluster 0 pgmap v772: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:54.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:54 smithi103 bash[27315]: cluster 1689213412.885021 mgr.a (mgr.14152) 892 : cluster 0 pgmap v772: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:56:56.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:56 smithi084 bash[27323]: cluster 1689213414.8855677 mgr.a (mgr.14152) 893 : cluster 0 pgmap v773: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:56.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:56 smithi022 bash[26979]: cluster 1689213414.8855677 mgr.a (mgr.14152) 893 : cluster 0 pgmap v773: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:56.745 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:56 smithi154 bash[27744]: cluster 1689213414.8855677 mgr.a (mgr.14152) 893 : cluster 0 pgmap v773: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:56.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:56 smithi137 bash[27262]: cluster 1689213414.8855677 mgr.a (mgr.14152) 893 : cluster 0 pgmap v773: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:56.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:56 smithi103 bash[27315]: cluster 1689213414.8855677 mgr.a (mgr.14152) 893 : cluster 0 pgmap v773: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:57.648 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:57 smithi022 bash[26979]: cluster 1689213416.8861077 mgr.a (mgr.14152) 894 : cluster 0 pgmap v774: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:57.744 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:57 smithi154 bash[27744]: cluster 1689213416.8861077 mgr.a (mgr.14152) 894 : cluster 0 pgmap v774: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:57.791 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:57 smithi137 bash[27262]: cluster 1689213416.8861077 mgr.a (mgr.14152) 894 : cluster 0 pgmap v774: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:57.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:57 smithi103 bash[27315]: cluster 1689213416.8861077 mgr.a (mgr.14152) 894 : cluster 0 pgmap v774: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:57.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:57 smithi084 bash[27323]: cluster 1689213416.8861077 mgr.a (mgr.14152) 894 : cluster 0 pgmap v774: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:56:59.657 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:00.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:59 smithi022 bash[26979]: cluster 1689213418.8866305 mgr.a (mgr.14152) 895 : cluster 0 pgmap v775: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:00.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:59 smithi022 bash[26979]: audit 1689213419.0428371 mon.a (mon.0) 1106 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:57:00.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:59 smithi022 bash[26979]: audit 1689213419.6774757 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.22:0/1237179255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:00.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:59 smithi022 bash[26979]: audit 1689213419.8467584 mon.a (mon.0) 1107 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:57:00.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:59 smithi022 bash[26979]: audit 1689213419.8480673 mon.a (mon.0) 1108 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:57:00.149 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:56:59 smithi022 bash[26979]: audit 1689213419.858242 mon.a (mon.0) 1109 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:57:00.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:59 smithi154 bash[27744]: cluster 1689213418.8866305 mgr.a (mgr.14152) 895 : cluster 0 pgmap v775: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:00.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:59 smithi154 bash[27744]: audit 1689213419.0428371 mon.a (mon.0) 1106 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:57:00.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:59 smithi154 bash[27744]: audit 1689213419.6774757 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.22:0/1237179255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:00.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:59 smithi154 bash[27744]: audit 1689213419.8467584 mon.a (mon.0) 1107 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:57:00.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:59 smithi154 bash[27744]: audit 1689213419.8480673 mon.a (mon.0) 1108 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:57:00.246 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:56:59 smithi154 bash[27744]: audit 1689213419.858242 mon.a (mon.0) 1109 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:57:00.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:59 smithi137 bash[27262]: cluster 1689213418.8866305 mgr.a (mgr.14152) 895 : cluster 0 pgmap v775: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:00.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:59 smithi137 bash[27262]: audit 1689213419.0428371 mon.a (mon.0) 1106 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:57:00.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:59 smithi137 bash[27262]: audit 1689213419.6774757 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.22:0/1237179255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:00.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:59 smithi137 bash[27262]: audit 1689213419.8467584 mon.a (mon.0) 1107 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:57:00.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:59 smithi137 bash[27262]: audit 1689213419.8480673 mon.a (mon.0) 1108 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:57:00.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:56:59 smithi137 bash[27262]: audit 1689213419.858242 mon.a (mon.0) 1109 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:57:00.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:59 smithi103 bash[27315]: cluster 1689213418.8866305 mgr.a (mgr.14152) 895 : cluster 0 pgmap v775: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:00.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:59 smithi103 bash[27315]: audit 1689213419.0428371 mon.a (mon.0) 1106 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:57:00.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:59 smithi103 bash[27315]: audit 1689213419.6774757 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.22:0/1237179255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:00.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:59 smithi103 bash[27315]: audit 1689213419.8467584 mon.a (mon.0) 1107 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:57:00.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:59 smithi103 bash[27315]: audit 1689213419.8480673 mon.a (mon.0) 1108 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:57:00.344 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:56:59 smithi103 bash[27315]: audit 1689213419.858242 mon.a (mon.0) 1109 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:57:00.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:59 smithi084 bash[27323]: cluster 1689213418.8866305 mgr.a (mgr.14152) 895 : cluster 0 pgmap v775: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:00.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:59 smithi084 bash[27323]: audit 1689213419.0428371 mon.a (mon.0) 1106 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:57:00.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:59 smithi084 bash[27323]: audit 1689213419.6774757 mon.c (mon.2) 15 : audit 0 from='client.? 172.21.15.22:0/1237179255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:00.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:59 smithi084 bash[27323]: audit 1689213419.8467584 mon.a (mon.0) 1107 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:57:00.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:59 smithi084 bash[27323]: audit 1689213419.8480673 mon.a (mon.0) 1108 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:57:00.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:56:59 smithi084 bash[27323]: audit 1689213419.858242 mon.a (mon.0) 1109 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:57:00.429 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:01.244 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:01 smithi154 bash[27744]: cluster 1689213419.8501818 mgr.a (mgr.14152) 896 : cluster 0 pgmap v776: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:01 smithi154 bash[27744]: cluster 1689213419.850513 mgr.a (mgr.14152) 897 : cluster 0 pgmap v777: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:01 smithi137 bash[27262]: cluster 1689213419.8501818 mgr.a (mgr.14152) 896 : cluster 0 pgmap v776: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.292 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:01 smithi137 bash[27262]: cluster 1689213419.850513 mgr.a (mgr.14152) 897 : cluster 0 pgmap v777: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:01 smithi103 bash[27315]: cluster 1689213419.8501818 mgr.a (mgr.14152) 896 : cluster 0 pgmap v776: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:01 smithi103 bash[27315]: cluster 1689213419.850513 mgr.a (mgr.14152) 897 : cluster 0 pgmap v777: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:01 smithi084 bash[27323]: cluster 1689213419.8501818 mgr.a (mgr.14152) 896 : cluster 0 pgmap v776: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:01 smithi084 bash[27323]: cluster 1689213419.850513 mgr.a (mgr.14152) 897 : cluster 0 pgmap v777: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:00 smithi022 bash[26979]: cluster 1689213419.8501818 mgr.a (mgr.14152) 896 : cluster 0 pgmap v776: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:00 smithi022 bash[26979]: cluster 1689213419.850513 mgr.a (mgr.14152) 897 : cluster 0 pgmap v777: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:01.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:03.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:03 smithi154 bash[27744]: cluster 1689213421.8510532 mgr.a (mgr.14152) 898 : cluster 0 pgmap v778: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:03.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:03 smithi137 bash[27262]: cluster 1689213421.8510532 mgr.a (mgr.14152) 898 : cluster 0 pgmap v778: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:03.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:03 smithi103 bash[27315]: cluster 1689213421.8510532 mgr.a (mgr.14152) 898 : cluster 0 pgmap v778: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:03.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:03 smithi084 bash[27323]: cluster 1689213421.8510532 mgr.a (mgr.14152) 898 : cluster 0 pgmap v778: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:03.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:03 smithi022 bash[26979]: cluster 1689213421.8510532 mgr.a (mgr.14152) 898 : cluster 0 pgmap v778: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:05.244 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:05 smithi154 bash[27744]: cluster 1689213423.8515964 mgr.a (mgr.14152) 899 : cluster 0 pgmap v779: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:05.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:05 smithi137 bash[27262]: cluster 1689213423.8515964 mgr.a (mgr.14152) 899 : cluster 0 pgmap v779: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:05.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:05 smithi103 bash[27315]: cluster 1689213423.8515964 mgr.a (mgr.14152) 899 : cluster 0 pgmap v779: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:05.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:05 smithi084 bash[27323]: cluster 1689213423.8515964 mgr.a (mgr.14152) 899 : cluster 0 pgmap v779: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:05.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:05 smithi022 bash[26979]: cluster 1689213423.8515964 mgr.a (mgr.14152) 899 : cluster 0 pgmap v779: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:06.125 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:57:07.245 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:07 smithi154 bash[27744]: cluster 1689213425.8520923 mgr.a (mgr.14152) 900 : cluster 0 pgmap v780: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:07.245 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:07 smithi022 bash[26979]: cluster 1689213425.8520923 mgr.a (mgr.14152) 900 : cluster 0 pgmap v780: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:07.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:07 smithi137 bash[27262]: cluster 1689213425.8520923 mgr.a (mgr.14152) 900 : cluster 0 pgmap v780: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:07.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:07 smithi103 bash[27315]: cluster 1689213425.8520923 mgr.a (mgr.14152) 900 : cluster 0 pgmap v780: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:07.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:07 smithi084 bash[27323]: cluster 1689213425.8520923 mgr.a (mgr.14152) 900 : cluster 0 pgmap v780: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:09.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:09 smithi137 bash[27262]: cluster 1689213427.8526347 mgr.a (mgr.14152) 901 : cluster 0 pgmap v781: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:09.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:09 smithi103 bash[27315]: cluster 1689213427.8526347 mgr.a (mgr.14152) 901 : cluster 0 pgmap v781: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:09.364 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:09.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:09 smithi084 bash[27323]: cluster 1689213427.8526347 mgr.a (mgr.14152) 901 : cluster 0 pgmap v781: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:09.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:09 smithi022 bash[26979]: cluster 1689213427.8526347 mgr.a (mgr.14152) 901 : cluster 0 pgmap v781: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:09.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:09 smithi154 bash[27744]: cluster 1689213427.8526347 mgr.a (mgr.14152) 901 : cluster 0 pgmap v781: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:10.114 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:10.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:10 smithi137 bash[27262]: audit 1689213429.381785 mon.a (mon.0) 1110 : audit 0 from='client.? 172.21.15.22:0/1739567038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:10.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:10 smithi103 bash[27315]: audit 1689213429.381785 mon.a (mon.0) 1110 : audit 0 from='client.? 172.21.15.22:0/1739567038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:10.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:10 smithi084 bash[27323]: audit 1689213429.381785 mon.a (mon.0) 1110 : audit 0 from='client.? 172.21.15.22:0/1739567038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:10.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:10 smithi022 bash[26979]: audit 1689213429.381785 mon.a (mon.0) 1110 : audit 0 from='client.? 172.21.15.22:0/1739567038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:10.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:10 smithi154 bash[27744]: audit 1689213429.381785 mon.a (mon.0) 1110 : audit 0 from='client.? 172.21.15.22:0/1739567038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:11.116 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:11.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:11 smithi137 bash[27262]: cluster 1689213429.853062 mgr.a (mgr.14152) 902 : cluster 0 pgmap v782: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:11.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:11 smithi103 bash[27315]: cluster 1689213429.853062 mgr.a (mgr.14152) 902 : cluster 0 pgmap v782: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:11.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:11 smithi084 bash[27323]: cluster 1689213429.853062 mgr.a (mgr.14152) 902 : cluster 0 pgmap v782: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:11.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:11 smithi022 bash[26979]: cluster 1689213429.853062 mgr.a (mgr.14152) 902 : cluster 0 pgmap v782: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:11.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:11 smithi154 bash[27744]: cluster 1689213429.853062 mgr.a (mgr.14152) 902 : cluster 0 pgmap v782: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:13.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:13 smithi137 bash[27262]: cluster 1689213431.85354 mgr.a (mgr.14152) 903 : cluster 0 pgmap v783: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:13.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:13 smithi103 bash[27315]: cluster 1689213431.85354 mgr.a (mgr.14152) 903 : cluster 0 pgmap v783: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:13.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:13 smithi084 bash[27323]: cluster 1689213431.85354 mgr.a (mgr.14152) 903 : cluster 0 pgmap v783: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:13.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:13 smithi022 bash[26979]: cluster 1689213431.85354 mgr.a (mgr.14152) 903 : cluster 0 pgmap v783: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:13.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:13 smithi154 bash[27744]: cluster 1689213431.85354 mgr.a (mgr.14152) 903 : cluster 0 pgmap v783: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:15.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:15 smithi137 bash[27262]: cluster 1689213433.8540168 mgr.a (mgr.14152) 904 : cluster 0 pgmap v784: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:15.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:15 smithi103 bash[27315]: cluster 1689213433.8540168 mgr.a (mgr.14152) 904 : cluster 0 pgmap v784: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:15.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:15 smithi084 bash[27323]: cluster 1689213433.8540168 mgr.a (mgr.14152) 904 : cluster 0 pgmap v784: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:15.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:15 smithi022 bash[26979]: cluster 1689213433.8540168 mgr.a (mgr.14152) 904 : cluster 0 pgmap v784: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:15.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:15 smithi154 bash[27744]: cluster 1689213433.8540168 mgr.a (mgr.14152) 904 : cluster 0 pgmap v784: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:57:17.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:17 smithi137 bash[27262]: cluster 1689213435.8543954 mgr.a (mgr.14152) 905 : cluster 0 pgmap v785: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:17.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:17 smithi103 bash[27315]: cluster 1689213435.8543954 mgr.a (mgr.14152) 905 : cluster 0 pgmap v785: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:17.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:17 smithi084 bash[27323]: cluster 1689213435.8543954 mgr.a (mgr.14152) 905 : cluster 0 pgmap v785: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:17.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:17 smithi022 bash[26979]: cluster 1689213435.8543954 mgr.a (mgr.14152) 905 : cluster 0 pgmap v785: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:17.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:17 smithi154 bash[27744]: cluster 1689213435.8543954 mgr.a (mgr.14152) 905 : cluster 0 pgmap v785: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:19.027 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:19.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:19 smithi137 bash[27262]: cluster 1689213437.854768 mgr.a (mgr.14152) 906 : cluster 0 pgmap v786: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:19.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:19 smithi103 bash[27315]: cluster 1689213437.854768 mgr.a (mgr.14152) 906 : cluster 0 pgmap v786: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:19.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:19 smithi084 bash[27323]: cluster 1689213437.854768 mgr.a (mgr.14152) 906 : cluster 0 pgmap v786: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:19.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:19 smithi022 bash[26979]: cluster 1689213437.854768 mgr.a (mgr.14152) 906 : cluster 0 pgmap v786: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:19.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:19 smithi154 bash[27744]: cluster 1689213437.854768 mgr.a (mgr.14152) 906 : cluster 0 pgmap v786: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:19.719 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:20.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:20 smithi137 bash[27262]: audit 1689213439.048456 mon.b (mon.4) 25 : audit 0 from='client.? 172.21.15.22:0/1229372505' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:20.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:20 smithi103 bash[27315]: audit 1689213439.048456 mon.b (mon.4) 25 : audit 0 from='client.? 172.21.15.22:0/1229372505' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:20.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:20 smithi084 bash[27323]: audit 1689213439.048456 mon.b (mon.4) 25 : audit 0 from='client.? 172.21.15.22:0/1229372505' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:20.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:20 smithi022 bash[26979]: audit 1689213439.048456 mon.b (mon.4) 25 : audit 0 from='client.? 172.21.15.22:0/1229372505' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:20.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:20 smithi154 bash[27744]: audit 1689213439.048456 mon.b (mon.4) 25 : audit 0 from='client.? 172.21.15.22:0/1229372505' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:20.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:21.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:21 smithi137 bash[27262]: cluster 1689213439.8553507 mgr.a (mgr.14152) 907 : cluster 0 pgmap v787: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:21.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:21 smithi103 bash[27315]: cluster 1689213439.8553507 mgr.a (mgr.14152) 907 : cluster 0 pgmap v787: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:21.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:21 smithi084 bash[27323]: cluster 1689213439.8553507 mgr.a (mgr.14152) 907 : cluster 0 pgmap v787: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:21.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:21 smithi022 bash[26979]: cluster 1689213439.8553507 mgr.a (mgr.14152) 907 : cluster 0 pgmap v787: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:21.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:21 smithi154 bash[27744]: cluster 1689213439.8553507 mgr.a (mgr.14152) 907 : cluster 0 pgmap v787: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:23.291 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:23 smithi137 bash[27262]: cluster 1689213441.8560002 mgr.a (mgr.14152) 908 : cluster 0 pgmap v788: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:23.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:23 smithi103 bash[27315]: cluster 1689213441.8560002 mgr.a (mgr.14152) 908 : cluster 0 pgmap v788: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:23.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:23 smithi084 bash[27323]: cluster 1689213441.8560002 mgr.a (mgr.14152) 908 : cluster 0 pgmap v788: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:23.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:23 smithi022 bash[26979]: cluster 1689213441.8560002 mgr.a (mgr.14152) 908 : cluster 0 pgmap v788: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:23.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:23 smithi154 bash[27744]: cluster 1689213441.8560002 mgr.a (mgr.14152) 908 : cluster 0 pgmap v788: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:25.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:25 smithi103 bash[27315]: cluster 1689213443.8566473 mgr.a (mgr.14152) 909 : cluster 0 pgmap v789: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:25.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:25 smithi084 bash[27323]: cluster 1689213443.8566473 mgr.a (mgr.14152) 909 : cluster 0 pgmap v789: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:25.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:25 smithi022 bash[26979]: cluster 1689213443.8566473 mgr.a (mgr.14152) 909 : cluster 0 pgmap v789: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:57:25.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:25 smithi154 bash[27744]: cluster 1689213443.8566473 mgr.a (mgr.14152) 909 : cluster 0 pgmap v789: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:25.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:25 smithi137 bash[27262]: cluster 1689213443.8566473 mgr.a (mgr.14152) 909 : cluster 0 pgmap v789: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:27.341 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:27 smithi022 bash[26979]: cluster 1689213445.8571334 mgr.a (mgr.14152) 910 : cluster 0 pgmap v790: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:27.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:27 smithi103 bash[27315]: cluster 1689213445.8571334 mgr.a (mgr.14152) 910 : cluster 0 pgmap v790: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:27.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:27 smithi084 bash[27323]: cluster 1689213445.8571334 mgr.a (mgr.14152) 910 : cluster 0 pgmap v790: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:27.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:27 smithi154 bash[27744]: cluster 1689213445.8571334 mgr.a (mgr.14152) 910 : cluster 0 pgmap v790: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:27.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:27 smithi137 bash[27262]: cluster 1689213445.8571334 mgr.a (mgr.14152) 910 : cluster 0 pgmap v790: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:28.635 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:29.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:29 smithi022 bash[26979]: cluster 1689213447.8576117 mgr.a (mgr.14152) 911 : cluster 0 pgmap v791: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:29.148 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:29 smithi022 bash[26979]: audit 1689213448.6588144 mon.e (mon.1) 19 : audit 0 from='client.? 172.21.15.22:0/1404229155' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:29.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:29 smithi103 bash[27315]: cluster 1689213447.8576117 mgr.a (mgr.14152) 911 : cluster 0 pgmap v791: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:29.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:29 smithi103 bash[27315]: audit 1689213448.6588144 mon.e (mon.1) 19 : audit 0 from='client.? 172.21.15.22:0/1404229155' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:29.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:29 smithi084 bash[27323]: cluster 1689213447.8576117 mgr.a (mgr.14152) 911 : cluster 0 pgmap v791: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:29.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:29 smithi084 bash[27323]: audit 1689213448.6588144 mon.e (mon.1) 19 : audit 0 from='client.? 172.21.15.22:0/1404229155' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:29.457 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:29.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:29 smithi154 bash[27744]: cluster 1689213447.8576117 mgr.a (mgr.14152) 911 : cluster 0 pgmap v791: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:29.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:29 smithi154 bash[27744]: audit 1689213448.6588144 mon.e (mon.1) 19 : audit 0 from='client.? 172.21.15.22:0/1404229155' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:29.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:29 smithi137 bash[27262]: cluster 1689213447.8576117 mgr.a (mgr.14152) 911 : cluster 0 pgmap v791: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:29.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:29 smithi137 bash[27262]: audit 1689213448.6588144 mon.e (mon.1) 19 : audit 0 from='client.? 172.21.15.22:0/1404229155' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:30.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:31.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:31 smithi103 bash[27315]: cluster 1689213449.8582418 mgr.a (mgr.14152) 912 : cluster 0 pgmap v792: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:31.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:31 smithi084 bash[27323]: cluster 1689213449.8582418 mgr.a (mgr.14152) 912 : cluster 0 pgmap v792: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:31.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:31 smithi022 bash[26979]: cluster 1689213449.8582418 mgr.a (mgr.14152) 912 : cluster 0 pgmap v792: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:31.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:31 smithi154 bash[27744]: cluster 1689213449.8582418 mgr.a (mgr.14152) 912 : cluster 0 pgmap v792: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:31.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:31 smithi137 bash[27262]: cluster 1689213449.8582418 mgr.a (mgr.14152) 912 : cluster 0 pgmap v792: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:33.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:33 smithi103 bash[27315]: cluster 1689213451.858947 mgr.a (mgr.14152) 913 : cluster 0 pgmap v793: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:33.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:33 smithi084 bash[27323]: cluster 1689213451.858947 mgr.a (mgr.14152) 913 : cluster 0 pgmap v793: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:33.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:33 smithi022 bash[26979]: cluster 1689213451.858947 mgr.a (mgr.14152) 913 : cluster 0 pgmap v793: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:33.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:33 smithi154 bash[27744]: cluster 1689213451.858947 mgr.a (mgr.14152) 913 : cluster 0 pgmap v793: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:33.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:33 smithi137 bash[27262]: cluster 1689213451.858947 mgr.a (mgr.14152) 913 : cluster 0 pgmap v793: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:35.160 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:57:35.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:35 smithi103 bash[27315]: cluster 1689213453.8595877 mgr.a (mgr.14152) 914 : cluster 0 pgmap v794: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:35.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:35 smithi084 bash[27323]: cluster 1689213453.8595877 mgr.a (mgr.14152) 914 : cluster 0 pgmap v794: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:35.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:35 smithi022 bash[26979]: cluster 1689213453.8595877 mgr.a (mgr.14152) 914 : cluster 0 pgmap v794: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:35.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:35 smithi154 bash[27744]: cluster 1689213453.8595877 mgr.a (mgr.14152) 914 : cluster 0 pgmap v794: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:35.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:35 smithi137 bash[27262]: cluster 1689213453.8595877 mgr.a (mgr.14152) 914 : cluster 0 pgmap v794: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:37.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:37 smithi103 bash[27315]: cluster 1689213455.860125 mgr.a (mgr.14152) 915 : cluster 0 pgmap v795: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:37.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:37 smithi084 bash[27323]: cluster 1689213455.860125 mgr.a (mgr.14152) 915 : cluster 0 pgmap v795: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:37.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:37 smithi022 bash[26979]: cluster 1689213455.860125 mgr.a (mgr.14152) 915 : cluster 0 pgmap v795: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:37.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:37 smithi154 bash[27744]: cluster 1689213455.860125 mgr.a (mgr.14152) 915 : cluster 0 pgmap v795: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:37.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:37 smithi137 bash[27262]: cluster 1689213455.860125 mgr.a (mgr.14152) 915 : cluster 0 pgmap v795: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:38.327 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:39.071 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:39.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:39 smithi103 bash[27315]: cluster 1689213457.860601 mgr.a (mgr.14152) 916 : cluster 0 pgmap v796: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:39.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:39 smithi103 bash[27315]: audit 1689213458.3451343 mon.a (mon.0) 1111 : audit 0 from='client.? 172.21.15.22:0/971579587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:39.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:39 smithi084 bash[27323]: cluster 1689213457.860601 mgr.a (mgr.14152) 916 : cluster 0 pgmap v796: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:39.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:39 smithi084 bash[27323]: audit 1689213458.3451343 mon.a (mon.0) 1111 : audit 0 from='client.? 172.21.15.22:0/971579587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:39.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:39 smithi022 bash[26979]: cluster 1689213457.860601 mgr.a (mgr.14152) 916 : cluster 0 pgmap v796: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:39.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:39 smithi022 bash[26979]: audit 1689213458.3451343 mon.a (mon.0) 1111 : audit 0 from='client.? 172.21.15.22:0/971579587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:39.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:39 smithi154 bash[27744]: cluster 1689213457.860601 mgr.a (mgr.14152) 916 : cluster 0 pgmap v796: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:39.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:39 smithi154 bash[27744]: audit 1689213458.3451343 mon.a (mon.0) 1111 : audit 0 from='client.? 172.21.15.22:0/971579587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:39.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:39 smithi137 bash[27262]: cluster 1689213457.860601 mgr.a (mgr.14152) 916 : cluster 0 pgmap v796: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:39.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:39 smithi137 bash[27262]: audit 1689213458.3451343 mon.a (mon.0) 1111 : audit 0 from='client.? 172.21.15.22:0/971579587' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:40.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:41.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:41 smithi103 bash[27315]: cluster 1689213459.8611236 mgr.a (mgr.14152) 917 : cluster 0 pgmap v797: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:41.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:41 smithi084 bash[27323]: cluster 1689213459.8611236 mgr.a (mgr.14152) 917 : cluster 0 pgmap v797: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:41.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:41 smithi022 bash[26979]: cluster 1689213459.8611236 mgr.a (mgr.14152) 917 : cluster 0 pgmap v797: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:41.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:41 smithi154 bash[27744]: cluster 1689213459.8611236 mgr.a (mgr.14152) 917 : cluster 0 pgmap v797: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:41.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:41 smithi137 bash[27262]: cluster 1689213459.8611236 mgr.a (mgr.14152) 917 : cluster 0 pgmap v797: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:43.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:43 smithi103 bash[27315]: cluster 1689213461.8616374 mgr.a (mgr.14152) 918 : cluster 0 pgmap v798: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:43.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:43 smithi084 bash[27323]: cluster 1689213461.8616374 mgr.a (mgr.14152) 918 : cluster 0 pgmap v798: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:43.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:43 smithi022 bash[26979]: cluster 1689213461.8616374 mgr.a (mgr.14152) 918 : cluster 0 pgmap v798: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:43.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:43 smithi154 bash[27744]: cluster 1689213461.8616374 mgr.a (mgr.14152) 918 : cluster 0 pgmap v798: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:43.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:43 smithi137 bash[27262]: cluster 1689213461.8616374 mgr.a (mgr.14152) 918 : cluster 0 pgmap v798: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:44.767 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:57:45.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:45 smithi103 bash[27315]: cluster 1689213463.8621676 mgr.a (mgr.14152) 919 : cluster 0 pgmap v799: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:45.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:45 smithi084 bash[27323]: cluster 1689213463.8621676 mgr.a (mgr.14152) 919 : cluster 0 pgmap v799: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:45.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:45 smithi022 bash[26979]: cluster 1689213463.8621676 mgr.a (mgr.14152) 919 : cluster 0 pgmap v799: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:45.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:45 smithi154 bash[27744]: cluster 1689213463.8621676 mgr.a (mgr.14152) 919 : cluster 0 pgmap v799: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:45.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:45 smithi137 bash[27262]: cluster 1689213463.8621676 mgr.a (mgr.14152) 919 : cluster 0 pgmap v799: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:47.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:47 smithi103 bash[27315]: cluster 1689213465.8627672 mgr.a (mgr.14152) 920 : cluster 0 pgmap v800: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:47.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:47 smithi084 bash[27323]: cluster 1689213465.8627672 mgr.a (mgr.14152) 920 : cluster 0 pgmap v800: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:47.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:47 smithi022 bash[26979]: cluster 1689213465.8627672 mgr.a (mgr.14152) 920 : cluster 0 pgmap v800: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:47.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:47 smithi154 bash[27744]: cluster 1689213465.8627672 mgr.a (mgr.14152) 920 : cluster 0 pgmap v800: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:47.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:47 smithi137 bash[27262]: cluster 1689213465.8627672 mgr.a (mgr.14152) 920 : cluster 0 pgmap v800: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:48.130 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:48.819 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:49.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:49 smithi084 bash[27323]: cluster 1689213467.8631148 mgr.a (mgr.14152) 921 : cluster 0 pgmap v801: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:49.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:49 smithi084 bash[27323]: audit 1689213468.1513996 mon.d (mon.3) 12 : audit 0 from='client.? 172.21.15.22:0/1052303173' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:49.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:49 smithi022 bash[26979]: cluster 1689213467.8631148 mgr.a (mgr.14152) 921 : cluster 0 pgmap v801: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:49.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:49 smithi022 bash[26979]: audit 1689213468.1513996 mon.d (mon.3) 12 : audit 0 from='client.? 172.21.15.22:0/1052303173' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:49.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:49 smithi154 bash[27744]: cluster 1689213467.8631148 mgr.a (mgr.14152) 921 : cluster 0 pgmap v801: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:49.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:49 smithi154 bash[27744]: audit 1689213468.1513996 mon.d (mon.3) 12 : audit 0 from='client.? 172.21.15.22:0/1052303173' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:49.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:49 smithi137 bash[27262]: cluster 1689213467.8631148 mgr.a (mgr.14152) 921 : cluster 0 pgmap v801: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:49.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:49 smithi137 bash[27262]: audit 1689213468.1513996 mon.d (mon.3) 12 : audit 0 from='client.? 172.21.15.22:0/1052303173' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:49.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:49 smithi103 bash[27315]: cluster 1689213467.8631148 mgr.a (mgr.14152) 921 : cluster 0 pgmap v801: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:49.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:49 smithi103 bash[27315]: audit 1689213468.1513996 mon.d (mon.3) 12 : audit 0 from='client.? 172.21.15.22:0/1052303173' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:49.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:51.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:51 smithi084 bash[27323]: cluster 1689213469.8636045 mgr.a (mgr.14152) 922 : cluster 0 pgmap v802: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:51.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:51 smithi022 bash[26979]: cluster 1689213469.8636045 mgr.a (mgr.14152) 922 : cluster 0 pgmap v802: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:51.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:51 smithi154 bash[27744]: cluster 1689213469.8636045 mgr.a (mgr.14152) 922 : cluster 0 pgmap v802: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:51.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:51 smithi137 bash[27262]: cluster 1689213469.8636045 mgr.a (mgr.14152) 922 : cluster 0 pgmap v802: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:51.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:51 smithi103 bash[27315]: cluster 1689213469.8636045 mgr.a (mgr.14152) 922 : cluster 0 pgmap v802: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:53.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:53 smithi084 bash[27323]: cluster 1689213471.8641703 mgr.a (mgr.14152) 923 : cluster 0 pgmap v803: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:53.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:53 smithi022 bash[26979]: cluster 1689213471.8641703 mgr.a (mgr.14152) 923 : cluster 0 pgmap v803: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:53.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:53 smithi154 bash[27744]: cluster 1689213471.8641703 mgr.a (mgr.14152) 923 : cluster 0 pgmap v803: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:53.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:53 smithi137 bash[27262]: cluster 1689213471.8641703 mgr.a (mgr.14152) 923 : cluster 0 pgmap v803: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:53.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:53 smithi103 bash[27315]: cluster 1689213471.8641703 mgr.a (mgr.14152) 923 : cluster 0 pgmap v803: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:54.521 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:57:55.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:55 smithi084 bash[27323]: cluster 1689213473.8647227 mgr.a (mgr.14152) 924 : cluster 0 pgmap v804: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:55.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:55 smithi022 bash[26979]: cluster 1689213473.8647227 mgr.a (mgr.14152) 924 : cluster 0 pgmap v804: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:55.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:55 smithi154 bash[27744]: cluster 1689213473.8647227 mgr.a (mgr.14152) 924 : cluster 0 pgmap v804: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:55.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:55 smithi137 bash[27262]: cluster 1689213473.8647227 mgr.a (mgr.14152) 924 : cluster 0 pgmap v804: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:55.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:55 smithi103 bash[27315]: cluster 1689213473.8647227 mgr.a (mgr.14152) 924 : cluster 0 pgmap v804: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:57.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:57 smithi084 bash[27323]: cluster 1689213475.8652515 mgr.a (mgr.14152) 925 : cluster 0 pgmap v805: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:57.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:57 smithi022 bash[26979]: cluster 1689213475.8652515 mgr.a (mgr.14152) 925 : cluster 0 pgmap v805: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:57.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:57 smithi154 bash[27744]: cluster 1689213475.8652515 mgr.a (mgr.14152) 925 : cluster 0 pgmap v805: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:57.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:57 smithi137 bash[27262]: cluster 1689213475.8652515 mgr.a (mgr.14152) 925 : cluster 0 pgmap v805: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:57.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:57 smithi103 bash[27315]: cluster 1689213475.8652515 mgr.a (mgr.14152) 925 : cluster 0 pgmap v805: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:57.683 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:57:58.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:58 smithi022 bash[26979]: audit 1689213477.7015734 mon.a (mon.0) 1112 : audit 0 from='client.? 172.21.15.22:0/3658400446' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:58.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:58 smithi084 bash[27323]: audit 1689213477.7015734 mon.a (mon.0) 1112 : audit 0 from='client.? 172.21.15.22:0/3658400446' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:58.425 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:57:58.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:58 smithi154 bash[27744]: audit 1689213477.7015734 mon.a (mon.0) 1112 : audit 0 from='client.? 172.21.15.22:0/3658400446' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:58.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:58 smithi137 bash[27262]: audit 1689213477.7015734 mon.a (mon.0) 1112 : audit 0 from='client.? 172.21.15.22:0/3658400446' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:58.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:58 smithi103 bash[27315]: audit 1689213477.7015734 mon.a (mon.0) 1112 : audit 0 from='client.? 172.21.15.22:0/3658400446' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:57:59.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:57:59 smithi084 bash[27323]: cluster 1689213477.8658018 mgr.a (mgr.14152) 926 : cluster 0 pgmap v806: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:59.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:57:59 smithi022 bash[26979]: cluster 1689213477.8658018 mgr.a (mgr.14152) 926 : cluster 0 pgmap v806: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:59.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:57:59.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:57:59 smithi154 bash[27744]: cluster 1689213477.8658018 mgr.a (mgr.14152) 926 : cluster 0 pgmap v806: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:59.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:57:59 smithi137 bash[27262]: cluster 1689213477.8658018 mgr.a (mgr.14152) 926 : cluster 0 pgmap v806: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:57:59.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:57:59 smithi103 bash[27315]: cluster 1689213477.8658018 mgr.a (mgr.14152) 926 : cluster 0 pgmap v806: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:00.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:00 smithi084 bash[27323]: audit 1689213480.0259514 mon.a (mon.0) 1113 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:58:00.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:00 smithi022 bash[26979]: audit 1689213480.0259514 mon.a (mon.0) 1113 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:58:00.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:00 smithi154 bash[27744]: audit 1689213480.0259514 mon.a (mon.0) 1113 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:58:00.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:00 smithi137 bash[27262]: audit 1689213480.0259514 mon.a (mon.0) 1113 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:58:00.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:00 smithi103 bash[27315]: audit 1689213480.0259514 mon.a (mon.0) 1113 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:58:01.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:01 smithi022 bash[26979]: cluster 1689213479.8663821 mgr.a (mgr.14152) 927 : cluster 0 pgmap v807: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:01.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:01 smithi022 bash[26979]: audit 1689213480.8311732 mon.a (mon.0) 1114 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:58:01.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:01 smithi022 bash[26979]: audit 1689213480.8329384 mon.a (mon.0) 1115 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:58:01.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:01 smithi022 bash[26979]: audit 1689213480.844804 mon.a (mon.0) 1116 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:58:01.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:01 smithi154 bash[27744]: cluster 1689213479.8663821 mgr.a (mgr.14152) 927 : cluster 0 pgmap v807: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:01.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:01 smithi154 bash[27744]: audit 1689213480.8311732 mon.a (mon.0) 1114 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:58:01.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:01 smithi154 bash[27744]: audit 1689213480.8329384 mon.a (mon.0) 1115 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:58:01.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:01 smithi154 bash[27744]: audit 1689213480.844804 mon.a (mon.0) 1116 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:58:01.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:01 smithi137 bash[27262]: cluster 1689213479.8663821 mgr.a (mgr.14152) 927 : cluster 0 pgmap v807: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:01.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:01 smithi137 bash[27262]: audit 1689213480.8311732 mon.a (mon.0) 1114 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:58:01.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:01 smithi137 bash[27262]: audit 1689213480.8329384 mon.a (mon.0) 1115 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:58:01.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:01 smithi137 bash[27262]: audit 1689213480.844804 mon.a (mon.0) 1116 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:58:01.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:01 smithi103 bash[27315]: cluster 1689213479.8663821 mgr.a (mgr.14152) 927 : cluster 0 pgmap v807: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:01.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:01 smithi103 bash[27315]: audit 1689213480.8311732 mon.a (mon.0) 1114 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:58:01.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:01 smithi103 bash[27315]: audit 1689213480.8329384 mon.a (mon.0) 1115 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:58:01.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:01 smithi103 bash[27315]: audit 1689213480.844804 mon.a (mon.0) 1116 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:58:01.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:01 smithi084 bash[27323]: cluster 1689213479.8663821 mgr.a (mgr.14152) 927 : cluster 0 pgmap v807: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:01.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:01 smithi084 bash[27323]: audit 1689213480.8311732 mon.a (mon.0) 1114 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:58:01.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:01 smithi084 bash[27323]: audit 1689213480.8329384 mon.a (mon.0) 1115 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:58:01.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:01 smithi084 bash[27323]: audit 1689213480.844804 mon.a (mon.0) 1116 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:58:02.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:02 smithi022 bash[26979]: cluster 1689213480.8362894 mgr.a (mgr.14152) 928 : cluster 0 pgmap v808: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:02 smithi022 bash[26979]: cluster 1689213480.836617 mgr.a (mgr.14152) 929 : cluster 0 pgmap v809: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:02 smithi154 bash[27744]: cluster 1689213480.8362894 mgr.a (mgr.14152) 928 : cluster 0 pgmap v808: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:02 smithi154 bash[27744]: cluster 1689213480.836617 mgr.a (mgr.14152) 929 : cluster 0 pgmap v809: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:02 smithi137 bash[27262]: cluster 1689213480.8362894 mgr.a (mgr.14152) 928 : cluster 0 pgmap v808: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:02 smithi137 bash[27262]: cluster 1689213480.836617 mgr.a (mgr.14152) 929 : cluster 0 pgmap v809: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:02 smithi103 bash[27315]: cluster 1689213480.8362894 mgr.a (mgr.14152) 928 : cluster 0 pgmap v808: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:02 smithi103 bash[27315]: cluster 1689213480.836617 mgr.a (mgr.14152) 929 : cluster 0 pgmap v809: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:02 smithi084 bash[27323]: cluster 1689213480.8362894 mgr.a (mgr.14152) 928 : cluster 0 pgmap v808: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:02.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:02 smithi084 bash[27323]: cluster 1689213480.836617 mgr.a (mgr.14152) 929 : cluster 0 pgmap v809: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:58:04.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:04 smithi022 bash[26979]: cluster 1689213482.8371124 mgr.a (mgr.14152) 930 : cluster 0 pgmap v810: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:04.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:04 smithi154 bash[27744]: cluster 1689213482.8371124 mgr.a (mgr.14152) 930 : cluster 0 pgmap v810: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:04.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:04 smithi137 bash[27262]: cluster 1689213482.8371124 mgr.a (mgr.14152) 930 : cluster 0 pgmap v810: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:04.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:04 smithi103 bash[27315]: cluster 1689213482.8371124 mgr.a (mgr.14152) 930 : cluster 0 pgmap v810: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:04.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:04 smithi084 bash[27323]: cluster 1689213482.8371124 mgr.a (mgr.14152) 930 : cluster 0 pgmap v810: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:06.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:06 smithi022 bash[26979]: cluster 1689213484.8376522 mgr.a (mgr.14152) 931 : cluster 0 pgmap v811: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:06.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:06 smithi154 bash[27744]: cluster 1689213484.8376522 mgr.a (mgr.14152) 931 : cluster 0 pgmap v811: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:06.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:06 smithi137 bash[27262]: cluster 1689213484.8376522 mgr.a (mgr.14152) 931 : cluster 0 pgmap v811: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:06.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:06 smithi103 bash[27315]: cluster 1689213484.8376522 mgr.a (mgr.14152) 931 : cluster 0 pgmap v811: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:06.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:06 smithi084 bash[27323]: cluster 1689213484.8376522 mgr.a (mgr.14152) 931 : cluster 0 pgmap v811: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:07.419 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:58:08.137 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:58:08.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:08 smithi022 bash[26979]: cluster 1689213486.838186 mgr.a (mgr.14152) 932 : cluster 0 pgmap v812: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:08.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:08 smithi022 bash[26979]: audit 1689213487.4371526 mon.a (mon.0) 1117 : audit 0 from='client.? 172.21.15.22:0/1619870355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:08.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:08 smithi154 bash[27744]: cluster 1689213486.838186 mgr.a (mgr.14152) 932 : cluster 0 pgmap v812: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:08.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:08 smithi154 bash[27744]: audit 1689213487.4371526 mon.a (mon.0) 1117 : audit 0 from='client.? 172.21.15.22:0/1619870355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:08.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:08 smithi137 bash[27262]: cluster 1689213486.838186 mgr.a (mgr.14152) 932 : cluster 0 pgmap v812: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:08.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:08 smithi137 bash[27262]: audit 1689213487.4371526 mon.a (mon.0) 1117 : audit 0 from='client.? 172.21.15.22:0/1619870355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:08.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:08 smithi103 bash[27315]: cluster 1689213486.838186 mgr.a (mgr.14152) 932 : cluster 0 pgmap v812: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:08.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:08 smithi103 bash[27315]: audit 1689213487.4371526 mon.a (mon.0) 1117 : audit 0 from='client.? 172.21.15.22:0/1619870355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:08.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:08 smithi084 bash[27323]: cluster 1689213486.838186 mgr.a (mgr.14152) 932 : cluster 0 pgmap v812: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:08.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:08 smithi084 bash[27323]: audit 1689213487.4371526 mon.a (mon.0) 1117 : audit 0 from='client.? 172.21.15.22:0/1619870355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:09.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:58:10.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:10 smithi154 bash[27744]: cluster 1689213488.8386502 mgr.a (mgr.14152) 933 : cluster 0 pgmap v813: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:10.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:10 smithi137 bash[27262]: cluster 1689213488.8386502 mgr.a (mgr.14152) 933 : cluster 0 pgmap v813: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:10.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:10 smithi103 bash[27315]: cluster 1689213488.8386502 mgr.a (mgr.14152) 933 : cluster 0 pgmap v813: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:10.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:10 smithi084 bash[27323]: cluster 1689213488.8386502 mgr.a (mgr.14152) 933 : cluster 0 pgmap v813: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:10.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:10 smithi022 bash[26979]: cluster 1689213488.8386502 mgr.a (mgr.14152) 933 : cluster 0 pgmap v813: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:12.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:12 smithi154 bash[27744]: cluster 1689213490.839196 mgr.a (mgr.14152) 934 : cluster 0 pgmap v814: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:12.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:12 smithi137 bash[27262]: cluster 1689213490.839196 mgr.a (mgr.14152) 934 : cluster 0 pgmap v814: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:12.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:12 smithi103 bash[27315]: cluster 1689213490.839196 mgr.a (mgr.14152) 934 : cluster 0 pgmap v814: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:12.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:12 smithi084 bash[27323]: cluster 1689213490.839196 mgr.a (mgr.14152) 934 : cluster 0 pgmap v814: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:12.647 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:12 smithi022 bash[26979]: cluster 1689213490.839196 mgr.a (mgr.14152) 934 : cluster 0 pgmap v814: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:13.838 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:58:14.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:14 smithi154 bash[27744]: cluster 1689213492.8396928 mgr.a (mgr.14152) 935 : cluster 0 pgmap v815: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:14.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:14 smithi137 bash[27262]: cluster 1689213492.8396928 mgr.a (mgr.14152) 935 : cluster 0 pgmap v815: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:14.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:14 smithi103 bash[27315]: cluster 1689213492.8396928 mgr.a (mgr.14152) 935 : cluster 0 pgmap v815: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:14.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:14 smithi084 bash[27323]: cluster 1689213492.8396928 mgr.a (mgr.14152) 935 : cluster 0 pgmap v815: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:14.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:14 smithi022 bash[26979]: cluster 1689213492.8396928 mgr.a (mgr.14152) 935 : cluster 0 pgmap v815: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:16.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:16 smithi154 bash[27744]: cluster 1689213494.8401682 mgr.a (mgr.14152) 936 : cluster 0 pgmap v816: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:16.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:16 smithi137 bash[27262]: cluster 1689213494.8401682 mgr.a (mgr.14152) 936 : cluster 0 pgmap v816: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:16.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:16 smithi103 bash[27315]: cluster 1689213494.8401682 mgr.a (mgr.14152) 936 : cluster 0 pgmap v816: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:16.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:16 smithi084 bash[27323]: cluster 1689213494.8401682 mgr.a (mgr.14152) 936 : cluster 0 pgmap v816: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:16.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:16 smithi022 bash[26979]: cluster 1689213494.8401682 mgr.a (mgr.14152) 936 : cluster 0 pgmap v816: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:17.100 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:58:17.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:17 smithi022 bash[26979]: audit 1689213497.1220005 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.22:0/3668819215' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:17.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:17 smithi154 bash[27744]: audit 1689213497.1220005 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.22:0/3668819215' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:17.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:17 smithi137 bash[27262]: audit 1689213497.1220005 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.22:0/3668819215' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:17.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:17 smithi103 bash[27315]: audit 1689213497.1220005 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.22:0/3668819215' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:17.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:17 smithi084 bash[27323]: audit 1689213497.1220005 mon.c (mon.2) 16 : audit 0 from='client.? 172.21.15.22:0/3668819215' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:17.849 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:58:18.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:18 smithi154 bash[27744]: cluster 1689213496.840616 mgr.a (mgr.14152) 937 : cluster 0 pgmap v817: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:18.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:18 smithi137 bash[27262]: cluster 1689213496.840616 mgr.a (mgr.14152) 937 : cluster 0 pgmap v817: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:18.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:18 smithi103 bash[27315]: cluster 1689213496.840616 mgr.a (mgr.14152) 937 : cluster 0 pgmap v817: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:18.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:18 smithi084 bash[27323]: cluster 1689213496.840616 mgr.a (mgr.14152) 937 : cluster 0 pgmap v817: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:18.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:18 smithi022 bash[26979]: cluster 1689213496.840616 mgr.a (mgr.14152) 937 : cluster 0 pgmap v817: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:18.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:58:20.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:20 smithi154 bash[27744]: cluster 1689213498.8411245 mgr.a (mgr.14152) 938 : cluster 0 pgmap v818: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:20.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:20 smithi137 bash[27262]: cluster 1689213498.8411245 mgr.a (mgr.14152) 938 : cluster 0 pgmap v818: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:20.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:20 smithi103 bash[27315]: cluster 1689213498.8411245 mgr.a (mgr.14152) 938 : cluster 0 pgmap v818: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:20.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:20 smithi084 bash[27323]: cluster 1689213498.8411245 mgr.a (mgr.14152) 938 : cluster 0 pgmap v818: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:20.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:20 smithi022 bash[26979]: cluster 1689213498.8411245 mgr.a (mgr.14152) 938 : cluster 0 pgmap v818: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:22.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:22 smithi154 bash[27744]: cluster 1689213500.8416357 mgr.a (mgr.14152) 939 : cluster 0 pgmap v819: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:22.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:22 smithi137 bash[27262]: cluster 1689213500.8416357 mgr.a (mgr.14152) 939 : cluster 0 pgmap v819: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:22.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:22 smithi103 bash[27315]: cluster 1689213500.8416357 mgr.a (mgr.14152) 939 : cluster 0 pgmap v819: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:22.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:22 smithi084 bash[27323]: cluster 1689213500.8416357 mgr.a (mgr.14152) 939 : cluster 0 pgmap v819: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:22.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:22 smithi022 bash[26979]: cluster 1689213500.8416357 mgr.a (mgr.14152) 939 : cluster 0 pgmap v819: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:23.548 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:58:24.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:24 smithi154 bash[27744]: cluster 1689213502.8421767 mgr.a (mgr.14152) 940 : cluster 0 pgmap v820: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:24.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:24 smithi137 bash[27262]: cluster 1689213502.8421767 mgr.a (mgr.14152) 940 : cluster 0 pgmap v820: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:24.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:24 smithi022 bash[26979]: cluster 1689213502.8421767 mgr.a (mgr.14152) 940 : cluster 0 pgmap v820: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:24.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:24 smithi103 bash[27315]: cluster 1689213502.8421767 mgr.a (mgr.14152) 940 : cluster 0 pgmap v820: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:24.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:24 smithi084 bash[27323]: cluster 1689213502.8421767 mgr.a (mgr.14152) 940 : cluster 0 pgmap v820: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:26.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:26 smithi022 bash[26979]: cluster 1689213504.8426352 mgr.a (mgr.14152) 941 : cluster 0 pgmap v821: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:26.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:26 smithi154 bash[27744]: cluster 1689213504.8426352 mgr.a (mgr.14152) 941 : cluster 0 pgmap v821: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:26.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:26 smithi137 bash[27262]: cluster 1689213504.8426352 mgr.a (mgr.14152) 941 : cluster 0 pgmap v821: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:26.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:26 smithi103 bash[27315]: cluster 1689213504.8426352 mgr.a (mgr.14152) 941 : cluster 0 pgmap v821: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:26.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:26 smithi084 bash[27323]: cluster 1689213504.8426352 mgr.a (mgr.14152) 941 : cluster 0 pgmap v821: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:26.856 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:58:27.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:27 smithi022 bash[26979]: audit 1689213506.8774996 mon.b (mon.4) 26 : audit 0 from='client.? 172.21.15.22:0/642163766' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:27.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:27 smithi154 bash[27744]: audit 1689213506.8774996 mon.b (mon.4) 26 : audit 0 from='client.? 172.21.15.22:0/642163766' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:27.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:27 smithi137 bash[27262]: audit 1689213506.8774996 mon.b (mon.4) 26 : audit 0 from='client.? 172.21.15.22:0/642163766' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:27.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:27 smithi103 bash[27315]: audit 1689213506.8774996 mon.b (mon.4) 26 : audit 0 from='client.? 172.21.15.22:0/642163766' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:27.610 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:58:27.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:27 smithi084 bash[27323]: audit 1689213506.8774996 mon.b (mon.4) 26 : audit 0 from='client.? 172.21.15.22:0/642163766' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:28.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:28 smithi154 bash[27744]: cluster 1689213506.8429887 mgr.a (mgr.14152) 942 : cluster 0 pgmap v822: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:28.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:28 smithi137 bash[27262]: cluster 1689213506.8429887 mgr.a (mgr.14152) 942 : cluster 0 pgmap v822: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:28.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:28 smithi103 bash[27315]: cluster 1689213506.8429887 mgr.a (mgr.14152) 942 : cluster 0 pgmap v822: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:28.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:58:28.624 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:28 smithi022 bash[26979]: cluster 1689213506.8429887 mgr.a (mgr.14152) 942 : cluster 0 pgmap v822: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:28.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:28 smithi084 bash[27323]: cluster 1689213506.8429887 mgr.a (mgr.14152) 942 : cluster 0 pgmap v822: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:30.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:30 smithi154 bash[27744]: cluster 1689213508.8434274 mgr.a (mgr.14152) 943 : cluster 0 pgmap v823: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:30.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:30 smithi137 bash[27262]: cluster 1689213508.8434274 mgr.a (mgr.14152) 943 : cluster 0 pgmap v823: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:30.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:30 smithi103 bash[27315]: cluster 1689213508.8434274 mgr.a (mgr.14152) 943 : cluster 0 pgmap v823: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:30.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:30 smithi084 bash[27323]: cluster 1689213508.8434274 mgr.a (mgr.14152) 943 : cluster 0 pgmap v823: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:30.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:30 smithi022 bash[26979]: cluster 1689213508.8434274 mgr.a (mgr.14152) 943 : cluster 0 pgmap v823: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:32.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:32 smithi154 bash[27744]: cluster 1689213510.843932 mgr.a (mgr.14152) 944 : cluster 0 pgmap v824: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:32.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:32 smithi137 bash[27262]: cluster 1689213510.843932 mgr.a (mgr.14152) 944 : cluster 0 pgmap v824: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:32.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:32 smithi103 bash[27315]: cluster 1689213510.843932 mgr.a (mgr.14152) 944 : cluster 0 pgmap v824: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:32.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:32 smithi084 bash[27323]: cluster 1689213510.843932 mgr.a (mgr.14152) 944 : cluster 0 pgmap v824: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:32.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:32 smithi022 bash[26979]: cluster 1689213510.843932 mgr.a (mgr.14152) 944 : cluster 0 pgmap v824: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:33.307 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:58:34.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:34 smithi022 bash[26979]: cluster 1689213512.844472 mgr.a (mgr.14152) 945 : cluster 0 pgmap v825: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:34.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:34 smithi154 bash[27744]: cluster 1689213512.844472 mgr.a (mgr.14152) 945 : cluster 0 pgmap v825: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:34.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:34 smithi137 bash[27262]: cluster 1689213512.844472 mgr.a (mgr.14152) 945 : cluster 0 pgmap v825: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:34.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:34 smithi103 bash[27315]: cluster 1689213512.844472 mgr.a (mgr.14152) 945 : cluster 0 pgmap v825: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:34.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:34 smithi084 bash[27323]: cluster 1689213512.844472 mgr.a (mgr.14152) 945 : cluster 0 pgmap v825: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:36.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:36 smithi022 bash[26979]: cluster 1689213514.8448336 mgr.a (mgr.14152) 946 : cluster 0 pgmap v826: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:36.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:36 smithi154 bash[27744]: cluster 1689213514.8448336 mgr.a (mgr.14152) 946 : cluster 0 pgmap v826: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:36.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:36 smithi137 bash[27262]: cluster 1689213514.8448336 mgr.a (mgr.14152) 946 : cluster 0 pgmap v826: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:36.579 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:58:36.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:36 smithi103 bash[27315]: cluster 1689213514.8448336 mgr.a (mgr.14152) 946 : cluster 0 pgmap v826: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:36.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:36 smithi084 bash[27323]: cluster 1689213514.8448336 mgr.a (mgr.14152) 946 : cluster 0 pgmap v826: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:37.369 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:58:37.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:37 smithi154 bash[27744]: audit 1689213516.5979023 mon.a (mon.0) 1118 : audit 0 from='client.? 172.21.15.22:0/1306995050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:37.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:37 smithi137 bash[27262]: audit 1689213516.5979023 mon.a (mon.0) 1118 : audit 0 from='client.? 172.21.15.22:0/1306995050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:37.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:37 smithi103 bash[27315]: audit 1689213516.5979023 mon.a (mon.0) 1118 : audit 0 from='client.? 172.21.15.22:0/1306995050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:37.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:37 smithi084 bash[27323]: audit 1689213516.5979023 mon.a (mon.0) 1118 : audit 0 from='client.? 172.21.15.22:0/1306995050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:37.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:37 smithi022 bash[26979]: audit 1689213516.5979023 mon.a (mon.0) 1118 : audit 0 from='client.? 172.21.15.22:0/1306995050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:38.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:58:38.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:38 smithi154 bash[27744]: cluster 1689213516.8453474 mgr.a (mgr.14152) 947 : cluster 0 pgmap v827: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:38.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:38 smithi137 bash[27262]: cluster 1689213516.8453474 mgr.a (mgr.14152) 947 : cluster 0 pgmap v827: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:38.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:38 smithi103 bash[27315]: cluster 1689213516.8453474 mgr.a (mgr.14152) 947 : cluster 0 pgmap v827: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:38.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:38 smithi084 bash[27323]: cluster 1689213516.8453474 mgr.a (mgr.14152) 947 : cluster 0 pgmap v827: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:38.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:38 smithi022 bash[26979]: cluster 1689213516.8453474 mgr.a (mgr.14152) 947 : cluster 0 pgmap v827: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:40.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:40 smithi154 bash[27744]: cluster 1689213518.845964 mgr.a (mgr.14152) 948 : cluster 0 pgmap v828: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:40.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:40 smithi137 bash[27262]: cluster 1689213518.845964 mgr.a (mgr.14152) 948 : cluster 0 pgmap v828: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:40.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:40 smithi103 bash[27315]: cluster 1689213518.845964 mgr.a (mgr.14152) 948 : cluster 0 pgmap v828: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:40.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:40 smithi084 bash[27323]: cluster 1689213518.845964 mgr.a (mgr.14152) 948 : cluster 0 pgmap v828: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:40.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:40 smithi022 bash[26979]: cluster 1689213518.845964 mgr.a (mgr.14152) 948 : cluster 0 pgmap v828: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:42.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:42 smithi137 bash[27262]: cluster 1689213520.8465326 mgr.a (mgr.14152) 949 : cluster 0 pgmap v829: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:42.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:42 smithi103 bash[27315]: cluster 1689213520.8465326 mgr.a (mgr.14152) 949 : cluster 0 pgmap v829: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:42.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:42 smithi084 bash[27323]: cluster 1689213520.8465326 mgr.a (mgr.14152) 949 : cluster 0 pgmap v829: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:42.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:42 smithi022 bash[26979]: cluster 1689213520.8465326 mgr.a (mgr.14152) 949 : cluster 0 pgmap v829: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:42.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:42 smithi154 bash[27744]: cluster 1689213520.8465326 mgr.a (mgr.14152) 949 : cluster 0 pgmap v829: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:43.069 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:58:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:44 smithi022 bash[26979]: cluster 1689213522.8471045 mgr.a (mgr.14152) 950 : cluster 0 pgmap v830: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:44.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:44 smithi137 bash[27262]: cluster 1689213522.8471045 mgr.a (mgr.14152) 950 : cluster 0 pgmap v830: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:44.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:44 smithi103 bash[27315]: cluster 1689213522.8471045 mgr.a (mgr.14152) 950 : cluster 0 pgmap v830: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:44.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:44 smithi084 bash[27323]: cluster 1689213522.8471045 mgr.a (mgr.14152) 950 : cluster 0 pgmap v830: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:44.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:44 smithi154 bash[27744]: cluster 1689213522.8471045 mgr.a (mgr.14152) 950 : cluster 0 pgmap v830: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:58:46.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:46 smithi137 bash[27262]: cluster 1689213524.8476045 mgr.a (mgr.14152) 951 : cluster 0 pgmap v831: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:46.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:46 smithi103 bash[27315]: cluster 1689213524.8476045 mgr.a (mgr.14152) 951 : cluster 0 pgmap v831: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:46.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:46 smithi022 bash[26979]: cluster 1689213524.8476045 mgr.a (mgr.14152) 951 : cluster 0 pgmap v831: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:46.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:46 smithi084 bash[27323]: cluster 1689213524.8476045 mgr.a (mgr.14152) 951 : cluster 0 pgmap v831: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:46.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:46 smithi154 bash[27744]: cluster 1689213524.8476045 mgr.a (mgr.14152) 951 : cluster 0 pgmap v831: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:47.104 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:58:47.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:47 smithi022 bash[26979]: audit 1689213526.4069202 mon.a (mon.0) 1119 : audit 0 from='client.? 172.21.15.22:0/1534475249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:47.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:47 smithi137 bash[27262]: audit 1689213526.4069202 mon.a (mon.0) 1119 : audit 0 from='client.? 172.21.15.22:0/1534475249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:47.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:47 smithi103 bash[27315]: audit 1689213526.4069202 mon.a (mon.0) 1119 : audit 0 from='client.? 172.21.15.22:0/1534475249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:47.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:47 smithi084 bash[27323]: audit 1689213526.4069202 mon.a (mon.0) 1119 : audit 0 from='client.? 172.21.15.22:0/1534475249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:47.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:47 smithi154 bash[27744]: audit 1689213526.4069202 mon.a (mon.0) 1119 : audit 0 from='client.? 172.21.15.22:0/1534475249' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:48.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:58:48.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:48 smithi022 bash[26979]: cluster 1689213526.8480992 mgr.a (mgr.14152) 952 : cluster 0 pgmap v832: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:48.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:48 smithi137 bash[27262]: cluster 1689213526.8480992 mgr.a (mgr.14152) 952 : cluster 0 pgmap v832: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:48.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:48 smithi103 bash[27315]: cluster 1689213526.8480992 mgr.a (mgr.14152) 952 : cluster 0 pgmap v832: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:48.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:48 smithi084 bash[27323]: cluster 1689213526.8480992 mgr.a (mgr.14152) 952 : cluster 0 pgmap v832: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:48.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:48 smithi154 bash[27744]: cluster 1689213526.8480992 mgr.a (mgr.14152) 952 : cluster 0 pgmap v832: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:50.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:50 smithi137 bash[27262]: cluster 1689213528.848631 mgr.a (mgr.14152) 953 : cluster 0 pgmap v833: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:50.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:50 smithi103 bash[27315]: cluster 1689213528.848631 mgr.a (mgr.14152) 953 : cluster 0 pgmap v833: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:50.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:50 smithi084 bash[27323]: cluster 1689213528.848631 mgr.a (mgr.14152) 953 : cluster 0 pgmap v833: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:50.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:50 smithi022 bash[26979]: cluster 1689213528.848631 mgr.a (mgr.14152) 953 : cluster 0 pgmap v833: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:50.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:50 smithi154 bash[27744]: cluster 1689213528.848631 mgr.a (mgr.14152) 953 : cluster 0 pgmap v833: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:52.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:52 smithi137 bash[27262]: cluster 1689213530.8491817 mgr.a (mgr.14152) 954 : cluster 0 pgmap v834: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:52.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:52 smithi103 bash[27315]: cluster 1689213530.8491817 mgr.a (mgr.14152) 954 : cluster 0 pgmap v834: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:52.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:52 smithi084 bash[27323]: cluster 1689213530.8491817 mgr.a (mgr.14152) 954 : cluster 0 pgmap v834: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:52.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:52 smithi022 bash[26979]: cluster 1689213530.8491817 mgr.a (mgr.14152) 954 : cluster 0 pgmap v834: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:52.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:52 smithi154 bash[27744]: cluster 1689213530.8491817 mgr.a (mgr.14152) 954 : cluster 0 pgmap v834: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:52.799 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:58:54.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:54 smithi137 bash[27262]: cluster 1689213532.8495965 mgr.a (mgr.14152) 955 : cluster 0 pgmap v835: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:54.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:54 smithi103 bash[27315]: cluster 1689213532.8495965 mgr.a (mgr.14152) 955 : cluster 0 pgmap v835: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:54.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:54 smithi084 bash[27323]: cluster 1689213532.8495965 mgr.a (mgr.14152) 955 : cluster 0 pgmap v835: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:54.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:54 smithi022 bash[26979]: cluster 1689213532.8495965 mgr.a (mgr.14152) 955 : cluster 0 pgmap v835: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:54.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:54 smithi154 bash[27744]: cluster 1689213532.8495965 mgr.a (mgr.14152) 955 : cluster 0 pgmap v835: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:56.085 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:58:56.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:56 smithi022 bash[26979]: cluster 1689213534.8501267 mgr.a (mgr.14152) 956 : cluster 0 pgmap v836: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:56.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:56 smithi022 bash[26979]: audit 1689213536.1044524 mon.a (mon.0) 1120 : audit 0 from='client.? 172.21.15.22:0/1975452653' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:56.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:56 smithi137 bash[27262]: cluster 1689213534.8501267 mgr.a (mgr.14152) 956 : cluster 0 pgmap v836: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:56.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:56 smithi137 bash[27262]: audit 1689213536.1044524 mon.a (mon.0) 1120 : audit 0 from='client.? 172.21.15.22:0/1975452653' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:56.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:56 smithi103 bash[27315]: cluster 1689213534.8501267 mgr.a (mgr.14152) 956 : cluster 0 pgmap v836: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:56.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:56 smithi103 bash[27315]: audit 1689213536.1044524 mon.a (mon.0) 1120 : audit 0 from='client.? 172.21.15.22:0/1975452653' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:56.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:56 smithi084 bash[27323]: cluster 1689213534.8501267 mgr.a (mgr.14152) 956 : cluster 0 pgmap v836: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:56.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:56 smithi084 bash[27323]: audit 1689213536.1044524 mon.a (mon.0) 1120 : audit 0 from='client.? 172.21.15.22:0/1975452653' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:56.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:56 smithi154 bash[27744]: cluster 1689213534.8501267 mgr.a (mgr.14152) 956 : cluster 0 pgmap v836: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:56.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:56 smithi154 bash[27744]: audit 1689213536.1044524 mon.a (mon.0) 1120 : audit 0 from='client.? 172.21.15.22:0/1975452653' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:58:56.754 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:58:57.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:58:58.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:58:58 smithi137 bash[27262]: cluster 1689213536.8506958 mgr.a (mgr.14152) 957 : cluster 0 pgmap v837: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:58.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:58:58 smithi103 bash[27315]: cluster 1689213536.8506958 mgr.a (mgr.14152) 957 : cluster 0 pgmap v837: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:58.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:58:58 smithi084 bash[27323]: cluster 1689213536.8506958 mgr.a (mgr.14152) 957 : cluster 0 pgmap v837: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:58.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:58:58 smithi022 bash[26979]: cluster 1689213536.8506958 mgr.a (mgr.14152) 957 : cluster 0 pgmap v837: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:58:58.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:58:58 smithi154 bash[27744]: cluster 1689213536.8506958 mgr.a (mgr.14152) 957 : cluster 0 pgmap v837: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:00.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:00 smithi103 bash[27315]: cluster 1689213538.8512163 mgr.a (mgr.14152) 958 : cluster 0 pgmap v838: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:00.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:00 smithi084 bash[27323]: cluster 1689213538.8512163 mgr.a (mgr.14152) 958 : cluster 0 pgmap v838: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:00.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:00 smithi022 bash[26979]: cluster 1689213538.8512163 mgr.a (mgr.14152) 958 : cluster 0 pgmap v838: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:00.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:00 smithi154 bash[27744]: cluster 1689213538.8512163 mgr.a (mgr.14152) 958 : cluster 0 pgmap v838: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:00.790 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:00 smithi137 bash[27262]: cluster 1689213538.8512163 mgr.a (mgr.14152) 958 : cluster 0 pgmap v838: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:01.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:01 smithi103 bash[27315]: audit 1689213541.0145187 mon.a (mon.0) 1121 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:59:01.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:01 smithi084 bash[27323]: audit 1689213541.0145187 mon.a (mon.0) 1121 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:59:01.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:01 smithi022 bash[26979]: audit 1689213541.0145187 mon.a (mon.0) 1121 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:59:01.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:01 smithi154 bash[27744]: audit 1689213541.0145187 mon.a (mon.0) 1121 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:59:01.790 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:01 smithi137 bash[27262]: audit 1689213541.0145187 mon.a (mon.0) 1121 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T01:59:02.448 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:59:02.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:02 smithi103 bash[27315]: cluster 1689213540.851705 mgr.a (mgr.14152) 959 : cluster 0 pgmap v839: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:02.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:02 smithi084 bash[27323]: cluster 1689213540.851705 mgr.a (mgr.14152) 959 : cluster 0 pgmap v839: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:02.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:02 smithi022 bash[26979]: cluster 1689213540.851705 mgr.a (mgr.14152) 959 : cluster 0 pgmap v839: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:02.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:02 smithi154 bash[27744]: cluster 1689213540.851705 mgr.a (mgr.14152) 959 : cluster 0 pgmap v839: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:02.790 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:02 smithi137 bash[27262]: cluster 1689213540.851705 mgr.a (mgr.14152) 959 : cluster 0 pgmap v839: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:04.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:04 smithi103 bash[27315]: cluster 1689213542.8522425 mgr.a (mgr.14152) 960 : cluster 0 pgmap v840: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:04.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:04 smithi084 bash[27323]: cluster 1689213542.8522425 mgr.a (mgr.14152) 960 : cluster 0 pgmap v840: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:04.645 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:04 smithi022 bash[26979]: cluster 1689213542.8522425 mgr.a (mgr.14152) 960 : cluster 0 pgmap v840: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:04.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:04 smithi154 bash[27744]: cluster 1689213542.8522425 mgr.a (mgr.14152) 960 : cluster 0 pgmap v840: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:04.790 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:04 smithi137 bash[27262]: cluster 1689213542.8522425 mgr.a (mgr.14152) 960 : cluster 0 pgmap v840: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:05.795 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:59:06.538 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:59:06.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:06 smithi103 bash[27315]: cluster 1689213544.8527668 mgr.a (mgr.14152) 961 : cluster 0 pgmap v841: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:06.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:06 smithi103 bash[27315]: audit 1689213545.815057 mon.a (mon.0) 1122 : audit 0 from='client.? 172.21.15.22:0/1923547255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:06.629 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:06 smithi084 bash[27323]: cluster 1689213544.8527668 mgr.a (mgr.14152) 961 : cluster 0 pgmap v841: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:06.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:06 smithi084 bash[27323]: audit 1689213545.815057 mon.a (mon.0) 1122 : audit 0 from='client.? 172.21.15.22:0/1923547255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:06.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:06 smithi022 bash[26979]: cluster 1689213544.8527668 mgr.a (mgr.14152) 961 : cluster 0 pgmap v841: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:06.646 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:06 smithi022 bash[26979]: audit 1689213545.815057 mon.a (mon.0) 1122 : audit 0 from='client.? 172.21.15.22:0/1923547255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:06.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:06 smithi154 bash[27744]: cluster 1689213544.8527668 mgr.a (mgr.14152) 961 : cluster 0 pgmap v841: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:06.743 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:06 smithi154 bash[27744]: audit 1689213545.815057 mon.a (mon.0) 1122 : audit 0 from='client.? 172.21.15.22:0/1923547255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:06.790 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:06 smithi137 bash[27262]: cluster 1689213544.8527668 mgr.a (mgr.14152) 961 : cluster 0 pgmap v841: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:06.790 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:06 smithi137 bash[27262]: audit 1689213545.815057 mon.a (mon.0) 1122 : audit 0 from='client.? 172.21.15.22:0/1923547255' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:07.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:59:07.840 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213546.5873659 mon.a (mon.0) 1123 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.841 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213546.595075 mon.a (mon.0) 1124 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.841 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: cluster 1689213546.8532906 mgr.a (mgr.14152) 962 : cluster 0 pgmap v842: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.841 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213547.0685108 mon.a (mon.0) 1125 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.841 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213547.0704155 mon.a (mon.0) 1126 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.841 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213547.072315 mon.a (mon.0) 1127 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: cephadm 1689213547.0736828 mgr.a (mgr.14152) 963 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:59:07.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213547.0763035 mon.a (mon.0) 1128 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:59:07.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213547.0778139 mon.a (mon.0) 1129 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:59:07.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: cluster 1689213547.0804267 mgr.a (mgr.14152) 964 : cluster 0 pgmap v843: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: cluster 1689213547.0807176 mgr.a (mgr.14152) 965 : cluster 0 pgmap v844: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.842 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:07 smithi103 bash[27315]: audit 1689213547.0882957 mon.a (mon.0) 1130 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213546.5873659 mon.a (mon.0) 1123 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.880 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213546.595075 mon.a (mon.0) 1124 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: cluster 1689213546.8532906 mgr.a (mgr.14152) 962 : cluster 0 pgmap v842: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213547.0685108 mon.a (mon.0) 1125 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213547.0704155 mon.a (mon.0) 1126 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.881 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213547.072315 mon.a (mon.0) 1127 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: cephadm 1689213547.0736828 mgr.a (mgr.14152) 963 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:59:07.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213547.0763035 mon.a (mon.0) 1128 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:59:07.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213547.0778139 mon.a (mon.0) 1129 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:59:07.882 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: cluster 1689213547.0804267 mgr.a (mgr.14152) 964 : cluster 0 pgmap v843: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.883 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: cluster 1689213547.0807176 mgr.a (mgr.14152) 965 : cluster 0 pgmap v844: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.883 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:07 smithi084 bash[27323]: audit 1689213547.0882957 mon.a (mon.0) 1130 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213546.5873659 mon.a (mon.0) 1123 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213546.595075 mon.a (mon.0) 1124 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: cluster 1689213546.8532906 mgr.a (mgr.14152) 962 : cluster 0 pgmap v842: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213547.0685108 mon.a (mon.0) 1125 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213547.0704155 mon.a (mon.0) 1126 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213547.072315 mon.a (mon.0) 1127 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: cephadm 1689213547.0736828 mgr.a (mgr.14152) 963 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213547.0763035 mon.a (mon.0) 1128 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:59:07.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213547.0778139 mon.a (mon.0) 1129 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:59:07.898 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: cluster 1689213547.0804267 mgr.a (mgr.14152) 964 : cluster 0 pgmap v843: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.898 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: cluster 1689213547.0807176 mgr.a (mgr.14152) 965 : cluster 0 pgmap v844: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.898 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:07 smithi022 bash[26979]: audit 1689213547.0882957 mon.a (mon.0) 1130 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.993 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213546.5873659 mon.a (mon.0) 1123 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.994 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213546.595075 mon.a (mon.0) 1124 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:07.994 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: cluster 1689213546.8532906 mgr.a (mgr.14152) 962 : cluster 0 pgmap v842: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.994 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213547.0685108 mon.a (mon.0) 1125 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.994 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213547.0704155 mon.a (mon.0) 1126 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.994 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213547.072315 mon.a (mon.0) 1127 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:07.994 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: cephadm 1689213547.0736828 mgr.a (mgr.14152) 963 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:59:07.995 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213547.0763035 mon.a (mon.0) 1128 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:59:07.995 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213547.0778139 mon.a (mon.0) 1129 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:59:07.995 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: cluster 1689213547.0804267 mgr.a (mgr.14152) 964 : cluster 0 pgmap v843: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.995 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: cluster 1689213547.0807176 mgr.a (mgr.14152) 965 : cluster 0 pgmap v844: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:07.995 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:07 smithi154 bash[27744]: audit 1689213547.0882957 mon.a (mon.0) 1130 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:08.040 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213546.5873659 mon.a (mon.0) 1123 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213546.595075 mon.a (mon.0) 1124 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: cluster 1689213546.8532906 mgr.a (mgr.14152) 962 : cluster 0 pgmap v842: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213547.0685108 mon.a (mon.0) 1125 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213547.0704155 mon.a (mon.0) 1126 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213547.072315 mon.a (mon.0) 1127 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: cephadm 1689213547.0736828 mgr.a (mgr.14152) 963 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T01:59:08.041 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213547.0763035 mon.a (mon.0) 1128 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T01:59:08.042 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213547.0778139 mon.a (mon.0) 1129 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T01:59:08.042 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: cluster 1689213547.0804267 mgr.a (mgr.14152) 964 : cluster 0 pgmap v843: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:08.042 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: cluster 1689213547.0807176 mgr.a (mgr.14152) 965 : cluster 0 pgmap v844: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:08.042 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:07 smithi137 bash[27262]: audit 1689213547.0882957 mon.a (mon.0) 1130 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T01:59:10.379 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:10 smithi084 bash[27323]: cluster 1689213549.0812216 mgr.a (mgr.14152) 966 : cluster 0 pgmap v845: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:10.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:10 smithi022 bash[26979]: cluster 1689213549.0812216 mgr.a (mgr.14152) 966 : cluster 0 pgmap v845: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:10.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:10 smithi154 bash[27744]: cluster 1689213549.0812216 mgr.a (mgr.14152) 966 : cluster 0 pgmap v845: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:10.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:10 smithi137 bash[27262]: cluster 1689213549.0812216 mgr.a (mgr.14152) 966 : cluster 0 pgmap v845: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:10.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:10 smithi103 bash[27315]: cluster 1689213549.0812216 mgr.a (mgr.14152) 966 : cluster 0 pgmap v845: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:12.239 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:59:12.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:12 smithi084 bash[27323]: cluster 1689213551.0817566 mgr.a (mgr.14152) 967 : cluster 0 pgmap v846: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:12.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:12 smithi022 bash[26979]: cluster 1689213551.0817566 mgr.a (mgr.14152) 967 : cluster 0 pgmap v846: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:12.493 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:12 smithi154 bash[27744]: cluster 1689213551.0817566 mgr.a (mgr.14152) 967 : cluster 0 pgmap v846: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:12.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:12 smithi137 bash[27262]: cluster 1689213551.0817566 mgr.a (mgr.14152) 967 : cluster 0 pgmap v846: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:12.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:12 smithi103 bash[27315]: cluster 1689213551.0817566 mgr.a (mgr.14152) 967 : cluster 0 pgmap v846: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:14.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:14 smithi084 bash[27323]: cluster 1689213553.0822923 mgr.a (mgr.14152) 968 : cluster 0 pgmap v847: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:14.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:14 smithi022 bash[26979]: cluster 1689213553.0822923 mgr.a (mgr.14152) 968 : cluster 0 pgmap v847: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:14.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:14 smithi154 bash[27744]: cluster 1689213553.0822923 mgr.a (mgr.14152) 968 : cluster 0 pgmap v847: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:14.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:14 smithi137 bash[27262]: cluster 1689213553.0822923 mgr.a (mgr.14152) 968 : cluster 0 pgmap v847: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:14.590 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:14 smithi103 bash[27315]: cluster 1689213553.0822923 mgr.a (mgr.14152) 968 : cluster 0 pgmap v847: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:15.617 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:59:16.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:16 smithi022 bash[26979]: cluster 1689213555.082795 mgr.a (mgr.14152) 969 : cluster 0 pgmap v848: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:16.147 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:16 smithi022 bash[26979]: audit 1689213555.6364486 mon.a (mon.0) 1131 : audit 0 from='client.? 172.21.15.22:0/503501997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:16.289 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:59:16.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:16 smithi103 bash[27315]: cluster 1689213555.082795 mgr.a (mgr.14152) 969 : cluster 0 pgmap v848: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:16.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:16 smithi103 bash[27315]: audit 1689213555.6364486 mon.a (mon.0) 1131 : audit 0 from='client.? 172.21.15.22:0/503501997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:16.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:16 smithi084 bash[27323]: cluster 1689213555.082795 mgr.a (mgr.14152) 969 : cluster 0 pgmap v848: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:16.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:16 smithi084 bash[27323]: audit 1689213555.6364486 mon.a (mon.0) 1131 : audit 0 from='client.? 172.21.15.22:0/503501997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:16.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:16 smithi154 bash[27744]: cluster 1689213555.082795 mgr.a (mgr.14152) 969 : cluster 0 pgmap v848: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:16.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:16 smithi154 bash[27744]: audit 1689213555.6364486 mon.a (mon.0) 1131 : audit 0 from='client.? 172.21.15.22:0/503501997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:16.540 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:16 smithi137 bash[27262]: cluster 1689213555.082795 mgr.a (mgr.14152) 969 : cluster 0 pgmap v848: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:16.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:16 smithi137 bash[27262]: audit 1689213555.6364486 mon.a (mon.0) 1131 : audit 0 from='client.? 172.21.15.22:0/503501997' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:17.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:59:18.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:18 smithi084 bash[27323]: cluster 1689213557.0832593 mgr.a (mgr.14152) 970 : cluster 0 pgmap v849: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:18.396 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:18 smithi022 bash[26979]: cluster 1689213557.0832593 mgr.a (mgr.14152) 970 : cluster 0 pgmap v849: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:18.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:18 smithi154 bash[27744]: cluster 1689213557.0832593 mgr.a (mgr.14152) 970 : cluster 0 pgmap v849: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:18.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:18 smithi137 bash[27262]: cluster 1689213557.0832593 mgr.a (mgr.14152) 970 : cluster 0 pgmap v849: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:18.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:18 smithi103 bash[27315]: cluster 1689213557.0832593 mgr.a (mgr.14152) 970 : cluster 0 pgmap v849: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:20.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:20 smithi084 bash[27323]: cluster 1689213559.083747 mgr.a (mgr.14152) 971 : cluster 0 pgmap v850: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:20.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:20 smithi022 bash[26979]: cluster 1689213559.083747 mgr.a (mgr.14152) 971 : cluster 0 pgmap v850: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:20.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:20 smithi154 bash[27744]: cluster 1689213559.083747 mgr.a (mgr.14152) 971 : cluster 0 pgmap v850: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:20.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:20 smithi137 bash[27262]: cluster 1689213559.083747 mgr.a (mgr.14152) 971 : cluster 0 pgmap v850: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:20.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:20 smithi103 bash[27315]: cluster 1689213559.083747 mgr.a (mgr.14152) 971 : cluster 0 pgmap v850: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:59:22.380 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:22 smithi084 bash[27323]: cluster 1689213561.0842285 mgr.a (mgr.14152) 972 : cluster 0 pgmap v851: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:22.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:22 smithi022 bash[26979]: cluster 1689213561.0842285 mgr.a (mgr.14152) 972 : cluster 0 pgmap v851: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:22.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:22 smithi154 bash[27744]: cluster 1689213561.0842285 mgr.a (mgr.14152) 972 : cluster 0 pgmap v851: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:22.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:22 smithi137 bash[27262]: cluster 1689213561.0842285 mgr.a (mgr.14152) 972 : cluster 0 pgmap v851: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:22.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:22 smithi103 bash[27315]: cluster 1689213561.0842285 mgr.a (mgr.14152) 972 : cluster 0 pgmap v851: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:24.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:24 smithi022 bash[26979]: cluster 1689213563.0847344 mgr.a (mgr.14152) 973 : cluster 0 pgmap v852: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:24.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:24 smithi154 bash[27744]: cluster 1689213563.0847344 mgr.a (mgr.14152) 973 : cluster 0 pgmap v852: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:24.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:24 smithi137 bash[27262]: cluster 1689213563.0847344 mgr.a (mgr.14152) 973 : cluster 0 pgmap v852: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:24.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:24 smithi103 bash[27315]: cluster 1689213563.0847344 mgr.a (mgr.14152) 973 : cluster 0 pgmap v852: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:24.630 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:24 smithi084 bash[27323]: cluster 1689213563.0847344 mgr.a (mgr.14152) 973 : cluster 0 pgmap v852: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:25.414 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:59:26.129 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:59:26.341 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:26 smithi103 bash[27315]: cluster 1689213565.0851865 mgr.a (mgr.14152) 974 : cluster 0 pgmap v853: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:26.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:26 smithi103 bash[27315]: audit 1689213565.4354663 mon.d (mon.3) 13 : audit 0 from='client.? 172.21.15.22:0/2153093788' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:26.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:26 smithi084 bash[27323]: cluster 1689213565.0851865 mgr.a (mgr.14152) 974 : cluster 0 pgmap v853: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:26.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:26 smithi084 bash[27323]: audit 1689213565.4354663 mon.d (mon.3) 13 : audit 0 from='client.? 172.21.15.22:0/2153093788' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:26.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:26 smithi022 bash[26979]: cluster 1689213565.0851865 mgr.a (mgr.14152) 974 : cluster 0 pgmap v853: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:26.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:26 smithi022 bash[26979]: audit 1689213565.4354663 mon.d (mon.3) 13 : audit 0 from='client.? 172.21.15.22:0/2153093788' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:26.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:26 smithi154 bash[27744]: cluster 1689213565.0851865 mgr.a (mgr.14152) 974 : cluster 0 pgmap v853: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:26.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:26 smithi154 bash[27744]: audit 1689213565.4354663 mon.d (mon.3) 13 : audit 0 from='client.? 172.21.15.22:0/2153093788' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:26.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:26 smithi137 bash[27262]: cluster 1689213565.0851865 mgr.a (mgr.14152) 974 : cluster 0 pgmap v853: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:26.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:26 smithi137 bash[27262]: audit 1689213565.4354663 mon.d (mon.3) 13 : audit 0 from='client.? 172.21.15.22:0/2153093788' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:27.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:59:28.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:28 smithi084 bash[27323]: cluster 1689213567.0857122 mgr.a (mgr.14152) 975 : cluster 0 pgmap v854: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:28.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:28 smithi022 bash[26979]: cluster 1689213567.0857122 mgr.a (mgr.14152) 975 : cluster 0 pgmap v854: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:28.494 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:28 smithi154 bash[27744]: cluster 1689213567.0857122 mgr.a (mgr.14152) 975 : cluster 0 pgmap v854: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:28.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:28 smithi137 bash[27262]: cluster 1689213567.0857122 mgr.a (mgr.14152) 975 : cluster 0 pgmap v854: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:28.591 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:28 smithi103 bash[27315]: cluster 1689213567.0857122 mgr.a (mgr.14152) 975 : cluster 0 pgmap v854: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:30.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:30 smithi084 bash[27323]: cluster 1689213569.0862381 mgr.a (mgr.14152) 976 : cluster 0 pgmap v855: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:30.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:30 smithi022 bash[26979]: cluster 1689213569.0862381 mgr.a (mgr.14152) 976 : cluster 0 pgmap v855: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:30.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:30 smithi154 bash[27744]: cluster 1689213569.0862381 mgr.a (mgr.14152) 976 : cluster 0 pgmap v855: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:30.541 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:30 smithi137 bash[27262]: cluster 1689213569.0862381 mgr.a (mgr.14152) 976 : cluster 0 pgmap v855: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:30.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:30 smithi103 bash[27315]: cluster 1689213569.0862381 mgr.a (mgr.14152) 976 : cluster 0 pgmap v855: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:59:32.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:32 smithi022 bash[26979]: cluster 1689213571.0867493 mgr.a (mgr.14152) 977 : cluster 0 pgmap v856: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:32.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:32 smithi154 bash[27744]: cluster 1689213571.0867493 mgr.a (mgr.14152) 977 : cluster 0 pgmap v856: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:32.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:32 smithi137 bash[27262]: cluster 1689213571.0867493 mgr.a (mgr.14152) 977 : cluster 0 pgmap v856: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:32.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:32 smithi103 bash[27315]: cluster 1689213571.0867493 mgr.a (mgr.14152) 977 : cluster 0 pgmap v856: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:32.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:32 smithi084 bash[27323]: cluster 1689213571.0867493 mgr.a (mgr.14152) 977 : cluster 0 pgmap v856: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:34.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:34 smithi022 bash[26979]: cluster 1689213573.0872667 mgr.a (mgr.14152) 978 : cluster 0 pgmap v857: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:34.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:34 smithi154 bash[27744]: cluster 1689213573.0872667 mgr.a (mgr.14152) 978 : cluster 0 pgmap v857: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:34.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:34 smithi137 bash[27262]: cluster 1689213573.0872667 mgr.a (mgr.14152) 978 : cluster 0 pgmap v857: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:34.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:34 smithi103 bash[27315]: cluster 1689213573.0872667 mgr.a (mgr.14152) 978 : cluster 0 pgmap v857: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:34.631 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:34 smithi084 bash[27323]: cluster 1689213573.0872667 mgr.a (mgr.14152) 978 : cluster 0 pgmap v857: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:35.276 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:59:36.002 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:59:36.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:36 smithi103 bash[27315]: cluster 1689213575.0876954 mgr.a (mgr.14152) 979 : cluster 0 pgmap v858: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:36.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:36 smithi103 bash[27315]: audit 1689213575.2961829 mon.b (mon.4) 27 : audit 0 from='client.? 172.21.15.22:0/1685817450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:36.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:36 smithi084 bash[27323]: cluster 1689213575.0876954 mgr.a (mgr.14152) 979 : cluster 0 pgmap v858: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:36.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:36 smithi084 bash[27323]: audit 1689213575.2961829 mon.b (mon.4) 27 : audit 0 from='client.? 172.21.15.22:0/1685817450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:36.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:36 smithi022 bash[26979]: cluster 1689213575.0876954 mgr.a (mgr.14152) 979 : cluster 0 pgmap v858: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:36.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:36 smithi022 bash[26979]: audit 1689213575.2961829 mon.b (mon.4) 27 : audit 0 from='client.? 172.21.15.22:0/1685817450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:36.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:36 smithi154 bash[27744]: cluster 1689213575.0876954 mgr.a (mgr.14152) 979 : cluster 0 pgmap v858: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:36.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:36 smithi154 bash[27744]: audit 1689213575.2961829 mon.b (mon.4) 27 : audit 0 from='client.? 172.21.15.22:0/1685817450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:36.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:36 smithi137 bash[27262]: cluster 1689213575.0876954 mgr.a (mgr.14152) 979 : cluster 0 pgmap v858: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:36.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:36 smithi137 bash[27262]: audit 1689213575.2961829 mon.b (mon.4) 27 : audit 0 from='client.? 172.21.15.22:0/1685817450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:37.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:59:38.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:38 smithi103 bash[27315]: cluster 1689213577.0881543 mgr.a (mgr.14152) 980 : cluster 0 pgmap v859: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:38.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:38 smithi084 bash[27323]: cluster 1689213577.0881543 mgr.a (mgr.14152) 980 : cluster 0 pgmap v859: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:38.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:38 smithi022 bash[26979]: cluster 1689213577.0881543 mgr.a (mgr.14152) 980 : cluster 0 pgmap v859: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:38.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:38 smithi154 bash[27744]: cluster 1689213577.0881543 mgr.a (mgr.14152) 980 : cluster 0 pgmap v859: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:38.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:38 smithi137 bash[27262]: cluster 1689213577.0881543 mgr.a (mgr.14152) 980 : cluster 0 pgmap v859: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:40.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:40 smithi103 bash[27315]: cluster 1689213579.0886893 mgr.a (mgr.14152) 981 : cluster 0 pgmap v860: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:40.381 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:40 smithi084 bash[27323]: cluster 1689213579.0886893 mgr.a (mgr.14152) 981 : cluster 0 pgmap v860: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:40.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:40 smithi022 bash[26979]: cluster 1689213579.0886893 mgr.a (mgr.14152) 981 : cluster 0 pgmap v860: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:40.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:40 smithi154 bash[27744]: cluster 1689213579.0886893 mgr.a (mgr.14152) 981 : cluster 0 pgmap v860: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:40.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:40 smithi137 bash[27262]: cluster 1689213579.0886893 mgr.a (mgr.14152) 981 : cluster 0 pgmap v860: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:41.705 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:59:42.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:42 smithi103 bash[27315]: cluster 1689213581.0892212 mgr.a (mgr.14152) 982 : cluster 0 pgmap v861: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:42.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:42 smithi084 bash[27323]: cluster 1689213581.0892212 mgr.a (mgr.14152) 982 : cluster 0 pgmap v861: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:42.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:42 smithi022 bash[26979]: cluster 1689213581.0892212 mgr.a (mgr.14152) 982 : cluster 0 pgmap v861: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:42.495 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:42 smithi154 bash[27744]: cluster 1689213581.0892212 mgr.a (mgr.14152) 982 : cluster 0 pgmap v861: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:42.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:42 smithi137 bash[27262]: cluster 1689213581.0892212 mgr.a (mgr.14152) 982 : cluster 0 pgmap v861: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:44.342 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:44 smithi103 bash[27315]: cluster 1689213583.0897145 mgr.a (mgr.14152) 983 : cluster 0 pgmap v862: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:44.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:44 smithi084 bash[27323]: cluster 1689213583.0897145 mgr.a (mgr.14152) 983 : cluster 0 pgmap v862: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:44.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:44 smithi022 bash[26979]: cluster 1689213583.0897145 mgr.a (mgr.14152) 983 : cluster 0 pgmap v862: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:44.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:44 smithi154 bash[27744]: cluster 1689213583.0897145 mgr.a (mgr.14152) 983 : cluster 0 pgmap v862: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:44.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:44 smithi137 bash[27262]: cluster 1689213583.0897145 mgr.a (mgr.14152) 983 : cluster 0 pgmap v862: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:44.976 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:59:45.343 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:45 smithi103 bash[27315]: audit 1689213584.9958305 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.22:0/183288633' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:45.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:45 smithi084 bash[27323]: audit 1689213584.9958305 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.22:0/183288633' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:45.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:45 smithi022 bash[26979]: audit 1689213584.9958305 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.22:0/183288633' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:45.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:45 smithi154 bash[27744]: audit 1689213584.9958305 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.22:0/183288633' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:45.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:45 smithi137 bash[27262]: audit 1689213584.9958305 mon.c (mon.2) 17 : audit 0 from='client.? 172.21.15.22:0/183288633' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:45.753 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:59:46.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:46 smithi084 bash[27323]: cluster 1689213585.0902565 mgr.a (mgr.14152) 984 : cluster 0 pgmap v863: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:46.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:46 smithi022 bash[26979]: cluster 1689213585.0902565 mgr.a (mgr.14152) 984 : cluster 0 pgmap v863: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:46.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:46 smithi154 bash[27744]: cluster 1689213585.0902565 mgr.a (mgr.14152) 984 : cluster 0 pgmap v863: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:46.542 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:46 smithi137 bash[27262]: cluster 1689213585.0902565 mgr.a (mgr.14152) 984 : cluster 0 pgmap v863: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:46.592 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:46 smithi103 bash[27315]: cluster 1689213585.0902565 mgr.a (mgr.14152) 984 : cluster 0 pgmap v863: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:46.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:59:48.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:48 smithi084 bash[27323]: cluster 1689213587.0907972 mgr.a (mgr.14152) 985 : cluster 0 pgmap v864: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:48.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:48 smithi022 bash[26979]: cluster 1689213587.0907972 mgr.a (mgr.14152) 985 : cluster 0 pgmap v864: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:48.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:48 smithi154 bash[27744]: cluster 1689213587.0907972 mgr.a (mgr.14152) 985 : cluster 0 pgmap v864: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:48.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:48 smithi137 bash[27262]: cluster 1689213587.0907972 mgr.a (mgr.14152) 985 : cluster 0 pgmap v864: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:48.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:48 smithi103 bash[27315]: cluster 1689213587.0907972 mgr.a (mgr.14152) 985 : cluster 0 pgmap v864: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:50.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:50 smithi084 bash[27323]: cluster 1689213589.0913448 mgr.a (mgr.14152) 986 : cluster 0 pgmap v865: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:50.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:50 smithi022 bash[26979]: cluster 1689213589.0913448 mgr.a (mgr.14152) 986 : cluster 0 pgmap v865: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:50.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:50 smithi154 bash[27744]: cluster 1689213589.0913448 mgr.a (mgr.14152) 986 : cluster 0 pgmap v865: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:50.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:50 smithi137 bash[27262]: cluster 1689213589.0913448 mgr.a (mgr.14152) 986 : cluster 0 pgmap v865: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:50.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:50 smithi103 bash[27315]: cluster 1689213589.0913448 mgr.a (mgr.14152) 986 : cluster 0 pgmap v865: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:51.453 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T01:59:52.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:52 smithi022 bash[26979]: cluster 1689213591.091833 mgr.a (mgr.14152) 987 : cluster 0 pgmap v866: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:52.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:52 smithi084 bash[27323]: cluster 1689213591.091833 mgr.a (mgr.14152) 987 : cluster 0 pgmap v866: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:52.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:52 smithi154 bash[27744]: cluster 1689213591.091833 mgr.a (mgr.14152) 987 : cluster 0 pgmap v866: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:52.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:52 smithi137 bash[27262]: cluster 1689213591.091833 mgr.a (mgr.14152) 987 : cluster 0 pgmap v866: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:52.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:52 smithi103 bash[27315]: cluster 1689213591.091833 mgr.a (mgr.14152) 987 : cluster 0 pgmap v866: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:54.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:54 smithi084 bash[27323]: cluster 1689213593.0923202 mgr.a (mgr.14152) 988 : cluster 0 pgmap v867: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:54.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:54 smithi022 bash[26979]: cluster 1689213593.0923202 mgr.a (mgr.14152) 988 : cluster 0 pgmap v867: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:54.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:54 smithi154 bash[27744]: cluster 1689213593.0923202 mgr.a (mgr.14152) 988 : cluster 0 pgmap v867: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:54.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:54 smithi137 bash[27262]: cluster 1689213593.0923202 mgr.a (mgr.14152) 988 : cluster 0 pgmap v867: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:54.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:54 smithi103 bash[27315]: cluster 1689213593.0923202 mgr.a (mgr.14152) 988 : cluster 0 pgmap v867: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:54.613 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T01:59:55.261 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T01:59:55.382 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:55 smithi084 bash[27323]: audit 1689213594.6349103 mon.e (mon.1) 20 : audit 0 from='client.? 172.21.15.22:0/3184585527' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:55.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:55 smithi022 bash[26979]: audit 1689213594.6349103 mon.e (mon.1) 20 : audit 0 from='client.? 172.21.15.22:0/3184585527' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:55.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:55 smithi154 bash[27744]: audit 1689213594.6349103 mon.e (mon.1) 20 : audit 0 from='client.? 172.21.15.22:0/3184585527' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:55.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:55 smithi137 bash[27262]: audit 1689213594.6349103 mon.e (mon.1) 20 : audit 0 from='client.? 172.21.15.22:0/3184585527' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:55.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:55 smithi103 bash[27315]: audit 1689213594.6349103 mon.e (mon.1) 20 : audit 0 from='client.? 172.21.15.22:0/3184585527' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T01:59:56.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T01:59:56.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:56 smithi084 bash[27323]: cluster 1689213595.092803 mgr.a (mgr.14152) 989 : cluster 0 pgmap v868: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:56.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:56 smithi022 bash[26979]: cluster 1689213595.092803 mgr.a (mgr.14152) 989 : cluster 0 pgmap v868: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:56.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:56 smithi154 bash[27744]: cluster 1689213595.092803 mgr.a (mgr.14152) 989 : cluster 0 pgmap v868: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:56.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:56 smithi137 bash[27262]: cluster 1689213595.092803 mgr.a (mgr.14152) 989 : cluster 0 pgmap v868: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:56.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:56 smithi103 bash[27315]: cluster 1689213595.092803 mgr.a (mgr.14152) 989 : cluster 0 pgmap v868: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:58.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 01:59:58 smithi084 bash[27323]: cluster 1689213597.093342 mgr.a (mgr.14152) 990 : cluster 0 pgmap v869: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:58.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 01:59:58 smithi022 bash[26979]: cluster 1689213597.093342 mgr.a (mgr.14152) 990 : cluster 0 pgmap v869: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:58.496 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 01:59:58 smithi154 bash[27744]: cluster 1689213597.093342 mgr.a (mgr.14152) 990 : cluster 0 pgmap v869: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:58.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 01:59:58 smithi137 bash[27262]: cluster 1689213597.093342 mgr.a (mgr.14152) 990 : cluster 0 pgmap v869: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T01:59:58.593 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 01:59:58 smithi103 bash[27315]: cluster 1689213597.093342 mgr.a (mgr.14152) 990 : cluster 0 pgmap v869: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:00.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213599.0938904 mgr.a (mgr.14152) 991 : cluster 0 pgmap v870: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:00.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0001779 mon.a (mon.0) 1132 : cluster 3 Health detail: HEALTH_WARN 14 failed cephadm daemon(s) 2023-07-13T02:00:00.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0002258 mon.a (mon.0) 1133 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 14 failed cephadm daemon(s) 2023-07-13T02:00:00.384 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0002491 mon.a (mon.0) 1134 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:00:00.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0002675 mon.a (mon.0) 1135 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:00:00.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0002847 mon.a (mon.0) 1136 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:00:00.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.000306 mon.a (mon.0) 1137 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:00:00.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0003312 mon.a (mon.0) 1138 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:00:00.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0003583 mon.a (mon.0) 1139 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:00:00.385 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0004041 mon.a (mon.0) 1140 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0004294 mon.a (mon.0) 1141 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.000452 mon.a (mon.0) 1142 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0004778 mon.a (mon.0) 1143 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.000502 mon.a (mon.0) 1144 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.000523 mon.a (mon.0) 1145 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0005581 mon.a (mon.0) 1146 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:00:00.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:00 smithi084 bash[27323]: cluster 1689213600.0005825 mon.a (mon.0) 1147 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:00:00.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213599.0938904 mgr.a (mgr.14152) 991 : cluster 0 pgmap v870: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:00.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0001779 mon.a (mon.0) 1132 : cluster 3 Health detail: HEALTH_WARN 14 failed cephadm daemon(s) 2023-07-13T02:00:00.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0002258 mon.a (mon.0) 1133 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 14 failed cephadm daemon(s) 2023-07-13T02:00:00.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0002491 mon.a (mon.0) 1134 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:00:00.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0002675 mon.a (mon.0) 1135 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:00:00.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0002847 mon.a (mon.0) 1136 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:00:00.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.000306 mon.a (mon.0) 1137 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0003312 mon.a (mon.0) 1138 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0003583 mon.a (mon.0) 1139 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0004041 mon.a (mon.0) 1140 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0004294 mon.a (mon.0) 1141 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.000452 mon.a (mon.0) 1142 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0004778 mon.a (mon.0) 1143 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.000502 mon.a (mon.0) 1144 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:00:00.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.000523 mon.a (mon.0) 1145 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:00:00.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0005581 mon.a (mon.0) 1146 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:00:00.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:00 smithi022 bash[26979]: cluster 1689213600.0005825 mon.a (mon.0) 1147 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:00:00.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213599.0938904 mgr.a (mgr.14152) 991 : cluster 0 pgmap v870: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:00.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0001779 mon.a (mon.0) 1132 : cluster 3 Health detail: HEALTH_WARN 14 failed cephadm daemon(s) 2023-07-13T02:00:00.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0002258 mon.a (mon.0) 1133 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 14 failed cephadm daemon(s) 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0002491 mon.a (mon.0) 1134 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0002675 mon.a (mon.0) 1135 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0002847 mon.a (mon.0) 1136 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.000306 mon.a (mon.0) 1137 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0003312 mon.a (mon.0) 1138 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0003583 mon.a (mon.0) 1139 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0004041 mon.a (mon.0) 1140 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:00:00.498 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0004294 mon.a (mon.0) 1141 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:00:00.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.000452 mon.a (mon.0) 1142 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:00:00.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0004778 mon.a (mon.0) 1143 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:00:00.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.000502 mon.a (mon.0) 1144 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:00:00.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.000523 mon.a (mon.0) 1145 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:00:00.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0005581 mon.a (mon.0) 1146 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:00:00.499 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:00 smithi154 bash[27744]: cluster 1689213600.0005825 mon.a (mon.0) 1147 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:00:00.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213599.0938904 mgr.a (mgr.14152) 991 : cluster 0 pgmap v870: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:00.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0001779 mon.a (mon.0) 1132 : cluster 3 Health detail: HEALTH_WARN 14 failed cephadm daemon(s) 2023-07-13T02:00:00.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0002258 mon.a (mon.0) 1133 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 14 failed cephadm daemon(s) 2023-07-13T02:00:00.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0002491 mon.a (mon.0) 1134 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:00:00.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0002675 mon.a (mon.0) 1135 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:00:00.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0002847 mon.a (mon.0) 1136 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:00:00.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.000306 mon.a (mon.0) 1137 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:00:00.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0003312 mon.a (mon.0) 1138 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:00:00.545 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0003583 mon.a (mon.0) 1139 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0004041 mon.a (mon.0) 1140 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0004294 mon.a (mon.0) 1141 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.000452 mon.a (mon.0) 1142 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0004778 mon.a (mon.0) 1143 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.000502 mon.a (mon.0) 1144 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.000523 mon.a (mon.0) 1145 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:00:00.546 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0005581 mon.a (mon.0) 1146 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:00:00.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:00 smithi137 bash[27262]: cluster 1689213600.0005825 mon.a (mon.0) 1147 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:00:00.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213599.0938904 mgr.a (mgr.14152) 991 : cluster 0 pgmap v870: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:00.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0001779 mon.a (mon.0) 1132 : cluster 3 Health detail: HEALTH_WARN 14 failed cephadm daemon(s) 2023-07-13T02:00:00.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0002258 mon.a (mon.0) 1133 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 14 failed cephadm daemon(s) 2023-07-13T02:00:00.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0002491 mon.a (mon.0) 1134 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0002675 mon.a (mon.0) 1135 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0002847 mon.a (mon.0) 1136 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.000306 mon.a (mon.0) 1137 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0003312 mon.a (mon.0) 1138 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0003583 mon.a (mon.0) 1139 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0004041 mon.a (mon.0) 1140 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:00:00.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0004294 mon.a (mon.0) 1141 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:00:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.000452 mon.a (mon.0) 1142 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:00:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0004778 mon.a (mon.0) 1143 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:00:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.000502 mon.a (mon.0) 1144 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:00:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.000523 mon.a (mon.0) 1145 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:00:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0005581 mon.a (mon.0) 1146 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:00:00.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:00 smithi103 bash[27315]: cluster 1689213600.0005825 mon.a (mon.0) 1147 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:00:00.959 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:00:02.354 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:02 smithi022 bash[26979]: cluster 1689213601.094421 mgr.a (mgr.14152) 992 : cluster 0 pgmap v871: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:02.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:02 smithi084 bash[27323]: cluster 1689213601.094421 mgr.a (mgr.14152) 992 : cluster 0 pgmap v871: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:02.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:02 smithi154 bash[27744]: cluster 1689213601.094421 mgr.a (mgr.14152) 992 : cluster 0 pgmap v871: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:02.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:02 smithi137 bash[27262]: cluster 1689213601.094421 mgr.a (mgr.14152) 992 : cluster 0 pgmap v871: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:02.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:02 smithi103 bash[27315]: cluster 1689213601.094421 mgr.a (mgr.14152) 992 : cluster 0 pgmap v871: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:04.304 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:00:04.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:04 smithi084 bash[27323]: cluster 1689213603.0949478 mgr.a (mgr.14152) 993 : cluster 0 pgmap v872: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:04.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:04 smithi022 bash[26979]: cluster 1689213603.0949478 mgr.a (mgr.14152) 993 : cluster 0 pgmap v872: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:04.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:04 smithi154 bash[27744]: cluster 1689213603.0949478 mgr.a (mgr.14152) 993 : cluster 0 pgmap v872: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:04.543 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:04 smithi137 bash[27262]: cluster 1689213603.0949478 mgr.a (mgr.14152) 993 : cluster 0 pgmap v872: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:04.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:04 smithi103 bash[27315]: cluster 1689213603.0949478 mgr.a (mgr.14152) 993 : cluster 0 pgmap v872: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:04.967 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:00:05.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:05 smithi022 bash[26979]: audit 1689213604.3229272 mon.d (mon.3) 14 : audit 0 from='client.? 172.21.15.22:0/734929363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:05.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:05 smithi154 bash[27744]: audit 1689213604.3229272 mon.d (mon.3) 14 : audit 0 from='client.? 172.21.15.22:0/734929363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:05.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:05 smithi137 bash[27262]: audit 1689213604.3229272 mon.d (mon.3) 14 : audit 0 from='client.? 172.21.15.22:0/734929363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:05.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:05 smithi103 bash[27315]: audit 1689213604.3229272 mon.d (mon.3) 14 : audit 0 from='client.? 172.21.15.22:0/734929363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:05.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:05 smithi084 bash[27323]: audit 1689213604.3229272 mon.d (mon.3) 14 : audit 0 from='client.? 172.21.15.22:0/734929363' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:05.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:00:06.399 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:06 smithi022 bash[26979]: cluster 1689213605.0954585 mgr.a (mgr.14152) 994 : cluster 0 pgmap v873: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:06.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:06 smithi154 bash[27744]: cluster 1689213605.0954585 mgr.a (mgr.14152) 994 : cluster 0 pgmap v873: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:06.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:06 smithi137 bash[27262]: cluster 1689213605.0954585 mgr.a (mgr.14152) 994 : cluster 0 pgmap v873: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:06.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:06 smithi103 bash[27315]: cluster 1689213605.0954585 mgr.a (mgr.14152) 994 : cluster 0 pgmap v873: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:06.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:06 smithi084 bash[27323]: cluster 1689213605.0954585 mgr.a (mgr.14152) 994 : cluster 0 pgmap v873: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:08.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:08 smithi022 bash[26979]: cluster 1689213607.0960288 mgr.a (mgr.14152) 995 : cluster 0 pgmap v874: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:08.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:08 smithi022 bash[26979]: audit 1689213607.2564287 mon.a (mon.0) 1148 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:00:08.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:08 smithi154 bash[27744]: cluster 1689213607.0960288 mgr.a (mgr.14152) 995 : cluster 0 pgmap v874: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:08.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:08 smithi154 bash[27744]: audit 1689213607.2564287 mon.a (mon.0) 1148 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:00:08.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:08 smithi137 bash[27262]: cluster 1689213607.0960288 mgr.a (mgr.14152) 995 : cluster 0 pgmap v874: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:08.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:08 smithi137 bash[27262]: audit 1689213607.2564287 mon.a (mon.0) 1148 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:00:08.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:08 smithi103 bash[27315]: cluster 1689213607.0960288 mgr.a (mgr.14152) 995 : cluster 0 pgmap v874: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:08.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:08 smithi103 bash[27315]: audit 1689213607.2564287 mon.a (mon.0) 1148 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:00:08.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:08 smithi084 bash[27323]: cluster 1689213607.0960288 mgr.a (mgr.14152) 995 : cluster 0 pgmap v874: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:08.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:08 smithi084 bash[27323]: audit 1689213607.2564287 mon.a (mon.0) 1148 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:00:10.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:10 smithi022 bash[26979]: cluster 1689213609.096581 mgr.a (mgr.14152) 996 : cluster 0 pgmap v875: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:10.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:10 smithi154 bash[27744]: cluster 1689213609.096581 mgr.a (mgr.14152) 996 : cluster 0 pgmap v875: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:10.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:10 smithi137 bash[27262]: cluster 1689213609.096581 mgr.a (mgr.14152) 996 : cluster 0 pgmap v875: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:10.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:10 smithi103 bash[27315]: cluster 1689213609.096581 mgr.a (mgr.14152) 996 : cluster 0 pgmap v875: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:10.633 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:10 smithi084 bash[27323]: cluster 1689213609.096581 mgr.a (mgr.14152) 996 : cluster 0 pgmap v875: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:10.671 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:00:12.400 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:12 smithi022 bash[26979]: cluster 1689213611.097136 mgr.a (mgr.14152) 997 : cluster 0 pgmap v876: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:12.497 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:12 smithi154 bash[27744]: cluster 1689213611.097136 mgr.a (mgr.14152) 997 : cluster 0 pgmap v876: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:12.544 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:12 smithi137 bash[27262]: cluster 1689213611.097136 mgr.a (mgr.14152) 997 : cluster 0 pgmap v876: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:12.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:12 smithi103 bash[27315]: cluster 1689213611.097136 mgr.a (mgr.14152) 997 : cluster 0 pgmap v876: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:12.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:12 smithi084 bash[27323]: cluster 1689213611.097136 mgr.a (mgr.14152) 997 : cluster 0 pgmap v876: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:13.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.3139617 mon.a (mon.0) 1149 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.3207943 mon.a (mon.0) 1150 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.790641 mon.a (mon.0) 1151 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.7922003 mon.a (mon.0) 1152 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.7937608 mon.a (mon.0) 1153 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.7966273 mon.a (mon.0) 1154 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:00:13.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.7978368 mon.a (mon.0) 1155 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:00:13.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:13 smithi103 bash[27315]: audit 1689213612.805761 mon.a (mon.0) 1156 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.3139617 mon.a (mon.0) 1149 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.3207943 mon.a (mon.0) 1150 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.790641 mon.a (mon.0) 1151 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.7922003 mon.a (mon.0) 1152 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.7937608 mon.a (mon.0) 1153 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.7966273 mon.a (mon.0) 1154 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:00:13.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.7978368 mon.a (mon.0) 1155 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:00:13.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:13 smithi084 bash[27323]: audit 1689213612.805761 mon.a (mon.0) 1156 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.3139617 mon.a (mon.0) 1149 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.3207943 mon.a (mon.0) 1150 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.790641 mon.a (mon.0) 1151 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.7922003 mon.a (mon.0) 1152 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.7937608 mon.a (mon.0) 1153 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.7966273 mon.a (mon.0) 1154 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:00:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.7978368 mon.a (mon.0) 1155 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:00:13.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:13 smithi022 bash[26979]: audit 1689213612.805761 mon.a (mon.0) 1156 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.3139617 mon.a (mon.0) 1149 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.3207943 mon.a (mon.0) 1150 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.790641 mon.a (mon.0) 1151 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.7922003 mon.a (mon.0) 1152 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.7937608 mon.a (mon.0) 1153 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.7966273 mon.a (mon.0) 1154 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:00:13.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.7978368 mon.a (mon.0) 1155 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:00:13.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:13 smithi154 bash[27744]: audit 1689213612.805761 mon.a (mon.0) 1156 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.794 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.3139617 mon.a (mon.0) 1149 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.3207943 mon.a (mon.0) 1150 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:13.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.790641 mon.a (mon.0) 1151 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.7922003 mon.a (mon.0) 1152 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.7937608 mon.a (mon.0) 1153 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:00:13.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.7966273 mon.a (mon.0) 1154 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:00:13.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.7978368 mon.a (mon.0) 1155 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:00:13.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:13 smithi137 bash[27262]: audit 1689213612.805761 mon.a (mon.0) 1156 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:00:14.128 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:00:14.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:14 smithi103 bash[27315]: cephadm 1689213612.7947633 mgr.a (mgr.14152) 998 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:00:14.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:14 smithi103 bash[27315]: cluster 1689213612.8002837 mgr.a (mgr.14152) 999 : cluster 0 pgmap v877: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:14 smithi103 bash[27315]: cluster 1689213612.8004591 mgr.a (mgr.14152) 1000 : cluster 0 pgmap v878: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.596 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:14 smithi103 bash[27315]: audit 1689213614.143651 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.22:0/4294316203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:14.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:14 smithi084 bash[27323]: cephadm 1689213612.7947633 mgr.a (mgr.14152) 998 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:00:14.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:14 smithi084 bash[27323]: cluster 1689213612.8002837 mgr.a (mgr.14152) 999 : cluster 0 pgmap v877: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:14 smithi084 bash[27323]: cluster 1689213612.8004591 mgr.a (mgr.14152) 1000 : cluster 0 pgmap v878: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:14 smithi084 bash[27323]: audit 1689213614.143651 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.22:0/4294316203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:14.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:14 smithi022 bash[26979]: cephadm 1689213612.7947633 mgr.a (mgr.14152) 998 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:00:14.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:14 smithi022 bash[26979]: cluster 1689213612.8002837 mgr.a (mgr.14152) 999 : cluster 0 pgmap v877: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:14 smithi022 bash[26979]: cluster 1689213612.8004591 mgr.a (mgr.14152) 1000 : cluster 0 pgmap v878: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:14 smithi022 bash[26979]: audit 1689213614.143651 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.22:0/4294316203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:14.747 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:14 smithi154 bash[27744]: cephadm 1689213612.7947633 mgr.a (mgr.14152) 998 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:00:14.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:14 smithi154 bash[27744]: cluster 1689213612.8002837 mgr.a (mgr.14152) 999 : cluster 0 pgmap v877: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:14 smithi154 bash[27744]: cluster 1689213612.8004591 mgr.a (mgr.14152) 1000 : cluster 0 pgmap v878: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:14 smithi154 bash[27744]: audit 1689213614.143651 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.22:0/4294316203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:14.794 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:14 smithi137 bash[27262]: cephadm 1689213612.7947633 mgr.a (mgr.14152) 998 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:00:14.794 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:14 smithi137 bash[27262]: cluster 1689213612.8002837 mgr.a (mgr.14152) 999 : cluster 0 pgmap v877: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:14 smithi137 bash[27262]: cluster 1689213612.8004591 mgr.a (mgr.14152) 1000 : cluster 0 pgmap v878: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:14.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:14 smithi137 bash[27262]: audit 1689213614.143651 mon.a (mon.0) 1157 : audit 0 from='client.? 172.21.15.22:0/4294316203' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:14.829 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:00:15.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:00:16.594 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:16 smithi103 bash[27315]: cluster 1689213614.8009717 mgr.a (mgr.14152) 1001 : cluster 0 pgmap v879: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:16.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:16 smithi084 bash[27323]: cluster 1689213614.8009717 mgr.a (mgr.14152) 1001 : cluster 0 pgmap v879: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:16.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:16 smithi022 bash[26979]: cluster 1689213614.8009717 mgr.a (mgr.14152) 1001 : cluster 0 pgmap v879: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:16.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:16 smithi154 bash[27744]: cluster 1689213614.8009717 mgr.a (mgr.14152) 1001 : cluster 0 pgmap v879: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:16.794 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:16 smithi137 bash[27262]: cluster 1689213614.8009717 mgr.a (mgr.14152) 1001 : cluster 0 pgmap v879: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:18.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:18 smithi103 bash[27315]: cluster 1689213616.8014915 mgr.a (mgr.14152) 1002 : cluster 0 pgmap v880: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:18.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:18 smithi084 bash[27323]: cluster 1689213616.8014915 mgr.a (mgr.14152) 1002 : cluster 0 pgmap v880: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:18.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:18 smithi022 bash[26979]: cluster 1689213616.8014915 mgr.a (mgr.14152) 1002 : cluster 0 pgmap v880: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:18.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:18 smithi154 bash[27744]: cluster 1689213616.8014915 mgr.a (mgr.14152) 1002 : cluster 0 pgmap v880: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:18.794 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:18 smithi137 bash[27262]: cluster 1689213616.8014915 mgr.a (mgr.14152) 1002 : cluster 0 pgmap v880: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:20.532 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:00:20.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:20 smithi022 bash[26979]: cluster 1689213618.8020551 mgr.a (mgr.14152) 1003 : cluster 0 pgmap v881: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:20.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:20 smithi103 bash[27315]: cluster 1689213618.8020551 mgr.a (mgr.14152) 1003 : cluster 0 pgmap v881: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:20.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:20 smithi084 bash[27323]: cluster 1689213618.8020551 mgr.a (mgr.14152) 1003 : cluster 0 pgmap v881: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:20.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:20 smithi154 bash[27744]: cluster 1689213618.8020551 mgr.a (mgr.14152) 1003 : cluster 0 pgmap v881: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:20.794 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:20 smithi137 bash[27262]: cluster 1689213618.8020551 mgr.a (mgr.14152) 1003 : cluster 0 pgmap v881: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:22.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:22 smithi103 bash[27315]: cluster 1689213620.8025913 mgr.a (mgr.14152) 1004 : cluster 0 pgmap v882: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:22.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:22 smithi084 bash[27323]: cluster 1689213620.8025913 mgr.a (mgr.14152) 1004 : cluster 0 pgmap v882: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:22.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:22 smithi022 bash[26979]: cluster 1689213620.8025913 mgr.a (mgr.14152) 1004 : cluster 0 pgmap v882: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:22.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:22 smithi154 bash[27744]: cluster 1689213620.8025913 mgr.a (mgr.14152) 1004 : cluster 0 pgmap v882: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:22.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:22 smithi137 bash[27262]: cluster 1689213620.8025913 mgr.a (mgr.14152) 1004 : cluster 0 pgmap v882: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:23.904 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:00:24.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:24 smithi022 bash[26979]: cluster 1689213622.803238 mgr.a (mgr.14152) 1005 : cluster 0 pgmap v883: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:24.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:24 smithi022 bash[26979]: audit 1689213623.9247353 mon.e (mon.1) 21 : audit 0 from='client.? 172.21.15.22:0/3094281300' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:24.577 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:00:24.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:24 smithi103 bash[27315]: cluster 1689213622.803238 mgr.a (mgr.14152) 1005 : cluster 0 pgmap v883: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:24.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:24 smithi103 bash[27315]: audit 1689213623.9247353 mon.e (mon.1) 21 : audit 0 from='client.? 172.21.15.22:0/3094281300' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:24.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:24 smithi084 bash[27323]: cluster 1689213622.803238 mgr.a (mgr.14152) 1005 : cluster 0 pgmap v883: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:24.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:24 smithi084 bash[27323]: audit 1689213623.9247353 mon.e (mon.1) 21 : audit 0 from='client.? 172.21.15.22:0/3094281300' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:24.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:24 smithi154 bash[27744]: cluster 1689213622.803238 mgr.a (mgr.14152) 1005 : cluster 0 pgmap v883: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:24.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:24 smithi154 bash[27744]: audit 1689213623.9247353 mon.e (mon.1) 21 : audit 0 from='client.? 172.21.15.22:0/3094281300' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:24.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:24 smithi137 bash[27262]: cluster 1689213622.803238 mgr.a (mgr.14152) 1005 : cluster 0 pgmap v883: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:24.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:24 smithi137 bash[27262]: audit 1689213623.9247353 mon.e (mon.1) 21 : audit 0 from='client.? 172.21.15.22:0/3094281300' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:25.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:00:26.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:26 smithi103 bash[27315]: cluster 1689213624.803925 mgr.a (mgr.14152) 1006 : cluster 0 pgmap v884: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:26.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:26 smithi084 bash[27323]: cluster 1689213624.803925 mgr.a (mgr.14152) 1006 : cluster 0 pgmap v884: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:26.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:26 smithi022 bash[26979]: cluster 1689213624.803925 mgr.a (mgr.14152) 1006 : cluster 0 pgmap v884: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:26.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:26 smithi154 bash[27744]: cluster 1689213624.803925 mgr.a (mgr.14152) 1006 : cluster 0 pgmap v884: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:26.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:26 smithi137 bash[27262]: cluster 1689213624.803925 mgr.a (mgr.14152) 1006 : cluster 0 pgmap v884: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:28.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:28 smithi103 bash[27315]: cluster 1689213626.8044908 mgr.a (mgr.14152) 1007 : cluster 0 pgmap v885: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:28.634 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:28 smithi084 bash[27323]: cluster 1689213626.8044908 mgr.a (mgr.14152) 1007 : cluster 0 pgmap v885: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:28.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:28 smithi022 bash[26979]: cluster 1689213626.8044908 mgr.a (mgr.14152) 1007 : cluster 0 pgmap v885: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:28.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:28 smithi154 bash[27744]: cluster 1689213626.8044908 mgr.a (mgr.14152) 1007 : cluster 0 pgmap v885: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:28.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:28 smithi137 bash[27262]: cluster 1689213626.8044908 mgr.a (mgr.14152) 1007 : cluster 0 pgmap v885: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:30.274 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:00:30.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:30 smithi103 bash[27315]: cluster 1689213628.8050096 mgr.a (mgr.14152) 1008 : cluster 0 pgmap v886: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:30.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:30 smithi084 bash[27323]: cluster 1689213628.8050096 mgr.a (mgr.14152) 1008 : cluster 0 pgmap v886: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:30.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:30 smithi022 bash[26979]: cluster 1689213628.8050096 mgr.a (mgr.14152) 1008 : cluster 0 pgmap v886: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:30.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:30 smithi154 bash[27744]: cluster 1689213628.8050096 mgr.a (mgr.14152) 1008 : cluster 0 pgmap v886: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:30.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:30 smithi137 bash[27262]: cluster 1689213628.8050096 mgr.a (mgr.14152) 1008 : cluster 0 pgmap v886: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:32.595 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:32 smithi103 bash[27315]: cluster 1689213630.805603 mgr.a (mgr.14152) 1009 : cluster 0 pgmap v887: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:32.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:32 smithi084 bash[27323]: cluster 1689213630.805603 mgr.a (mgr.14152) 1009 : cluster 0 pgmap v887: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:32.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:32 smithi022 bash[26979]: cluster 1689213630.805603 mgr.a (mgr.14152) 1009 : cluster 0 pgmap v887: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:32.748 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:32 smithi154 bash[27744]: cluster 1689213630.805603 mgr.a (mgr.14152) 1009 : cluster 0 pgmap v887: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:32.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:32 smithi137 bash[27262]: cluster 1689213630.805603 mgr.a (mgr.14152) 1009 : cluster 0 pgmap v887: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:33.625 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:00:34.364 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:00:34.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:34 smithi084 bash[27323]: cluster 1689213632.8061717 mgr.a (mgr.14152) 1010 : cluster 0 pgmap v888: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:34.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:34 smithi084 bash[27323]: audit 1689213633.642295 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.22:0/3148746211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:34.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:34 smithi022 bash[26979]: cluster 1689213632.8061717 mgr.a (mgr.14152) 1010 : cluster 0 pgmap v888: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:34.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:34 smithi022 bash[26979]: audit 1689213633.642295 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.22:0/3148746211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:34.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:34 smithi154 bash[27744]: cluster 1689213632.8061717 mgr.a (mgr.14152) 1010 : cluster 0 pgmap v888: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:34.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:34 smithi154 bash[27744]: audit 1689213633.642295 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.22:0/3148746211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:34.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:34 smithi137 bash[27262]: cluster 1689213632.8061717 mgr.a (mgr.14152) 1010 : cluster 0 pgmap v888: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:34.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:34 smithi137 bash[27262]: audit 1689213633.642295 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.22:0/3148746211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:34.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:34 smithi103 bash[27315]: cluster 1689213632.8061717 mgr.a (mgr.14152) 1010 : cluster 0 pgmap v888: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:34.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:34 smithi103 bash[27315]: audit 1689213633.642295 mon.c (mon.2) 18 : audit 0 from='client.? 172.21.15.22:0/3148746211' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:35.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:00:36.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:36 smithi084 bash[27323]: cluster 1689213634.8066874 mgr.a (mgr.14152) 1011 : cluster 0 pgmap v889: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:36.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:36 smithi022 bash[26979]: cluster 1689213634.8066874 mgr.a (mgr.14152) 1011 : cluster 0 pgmap v889: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:36.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:36 smithi154 bash[27744]: cluster 1689213634.8066874 mgr.a (mgr.14152) 1011 : cluster 0 pgmap v889: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:36.795 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:36 smithi137 bash[27262]: cluster 1689213634.8066874 mgr.a (mgr.14152) 1011 : cluster 0 pgmap v889: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:36.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:36 smithi103 bash[27315]: cluster 1689213634.8066874 mgr.a (mgr.14152) 1011 : cluster 0 pgmap v889: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:38.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:38 smithi084 bash[27323]: cluster 1689213636.8072128 mgr.a (mgr.14152) 1012 : cluster 0 pgmap v890: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:38.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:38 smithi022 bash[26979]: cluster 1689213636.8072128 mgr.a (mgr.14152) 1012 : cluster 0 pgmap v890: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:38.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:38 smithi154 bash[27744]: cluster 1689213636.8072128 mgr.a (mgr.14152) 1012 : cluster 0 pgmap v890: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:38.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:38 smithi137 bash[27262]: cluster 1689213636.8072128 mgr.a (mgr.14152) 1012 : cluster 0 pgmap v890: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:38.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:38 smithi103 bash[27315]: cluster 1689213636.8072128 mgr.a (mgr.14152) 1012 : cluster 0 pgmap v890: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:40.054 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:00:40.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:40 smithi084 bash[27323]: cluster 1689213638.8077319 mgr.a (mgr.14152) 1013 : cluster 0 pgmap v891: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:40.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:40 smithi022 bash[26979]: cluster 1689213638.8077319 mgr.a (mgr.14152) 1013 : cluster 0 pgmap v891: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:40.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:40 smithi154 bash[27744]: cluster 1689213638.8077319 mgr.a (mgr.14152) 1013 : cluster 0 pgmap v891: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:40.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:40 smithi137 bash[27262]: cluster 1689213638.8077319 mgr.a (mgr.14152) 1013 : cluster 0 pgmap v891: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:40.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:40 smithi103 bash[27315]: cluster 1689213638.8077319 mgr.a (mgr.14152) 1013 : cluster 0 pgmap v891: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:42.635 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:42 smithi084 bash[27323]: cluster 1689213640.8082585 mgr.a (mgr.14152) 1014 : cluster 0 pgmap v892: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:42.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:42 smithi022 bash[26979]: cluster 1689213640.8082585 mgr.a (mgr.14152) 1014 : cluster 0 pgmap v892: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:42.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:42 smithi154 bash[27744]: cluster 1689213640.8082585 mgr.a (mgr.14152) 1014 : cluster 0 pgmap v892: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:42.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:42 smithi137 bash[27262]: cluster 1689213640.8082585 mgr.a (mgr.14152) 1014 : cluster 0 pgmap v892: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:42.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:42 smithi103 bash[27315]: cluster 1689213640.8082585 mgr.a (mgr.14152) 1014 : cluster 0 pgmap v892: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:43.374 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:00:44.085 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:00:44.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:44 smithi084 bash[27323]: cluster 1689213642.808781 mgr.a (mgr.14152) 1015 : cluster 0 pgmap v893: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:44.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:44 smithi084 bash[27323]: audit 1689213643.3936472 mon.e (mon.1) 22 : audit 0 from='client.? 172.21.15.22:0/693578409' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:44 smithi022 bash[26979]: cluster 1689213642.808781 mgr.a (mgr.14152) 1015 : cluster 0 pgmap v893: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:44.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:44 smithi022 bash[26979]: audit 1689213643.3936472 mon.e (mon.1) 22 : audit 0 from='client.? 172.21.15.22:0/693578409' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:44.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:44 smithi154 bash[27744]: cluster 1689213642.808781 mgr.a (mgr.14152) 1015 : cluster 0 pgmap v893: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:44.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:44 smithi154 bash[27744]: audit 1689213643.3936472 mon.e (mon.1) 22 : audit 0 from='client.? 172.21.15.22:0/693578409' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:44.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:44 smithi137 bash[27262]: cluster 1689213642.808781 mgr.a (mgr.14152) 1015 : cluster 0 pgmap v893: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:44.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:44 smithi137 bash[27262]: audit 1689213643.3936472 mon.e (mon.1) 22 : audit 0 from='client.? 172.21.15.22:0/693578409' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:44.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:44 smithi103 bash[27315]: cluster 1689213642.808781 mgr.a (mgr.14152) 1015 : cluster 0 pgmap v893: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:44.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:44 smithi103 bash[27315]: audit 1689213643.3936472 mon.e (mon.1) 22 : audit 0 from='client.? 172.21.15.22:0/693578409' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:45.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:00:46.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:46 smithi084 bash[27323]: cluster 1689213644.8092892 mgr.a (mgr.14152) 1016 : cluster 0 pgmap v894: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:46.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:46 smithi022 bash[26979]: cluster 1689213644.8092892 mgr.a (mgr.14152) 1016 : cluster 0 pgmap v894: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:46.749 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:46 smithi154 bash[27744]: cluster 1689213644.8092892 mgr.a (mgr.14152) 1016 : cluster 0 pgmap v894: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:46.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:46 smithi137 bash[27262]: cluster 1689213644.8092892 mgr.a (mgr.14152) 1016 : cluster 0 pgmap v894: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:46.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:46 smithi103 bash[27315]: cluster 1689213644.8092892 mgr.a (mgr.14152) 1016 : cluster 0 pgmap v894: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:48.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:48 smithi084 bash[27323]: cluster 1689213646.809762 mgr.a (mgr.14152) 1017 : cluster 0 pgmap v895: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:48.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:48 smithi022 bash[26979]: cluster 1689213646.809762 mgr.a (mgr.14152) 1017 : cluster 0 pgmap v895: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:48.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:48 smithi154 bash[27744]: cluster 1689213646.809762 mgr.a (mgr.14152) 1017 : cluster 0 pgmap v895: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:48.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:48 smithi137 bash[27262]: cluster 1689213646.809762 mgr.a (mgr.14152) 1017 : cluster 0 pgmap v895: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:48.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:48 smithi103 bash[27315]: cluster 1689213646.809762 mgr.a (mgr.14152) 1017 : cluster 0 pgmap v895: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:49.781 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:00:50.636 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:50 smithi084 bash[27323]: cluster 1689213648.8102462 mgr.a (mgr.14152) 1018 : cluster 0 pgmap v896: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:50.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:50 smithi022 bash[26979]: cluster 1689213648.8102462 mgr.a (mgr.14152) 1018 : cluster 0 pgmap v896: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:50.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:50 smithi154 bash[27744]: cluster 1689213648.8102462 mgr.a (mgr.14152) 1018 : cluster 0 pgmap v896: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:50.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:50 smithi137 bash[27262]: cluster 1689213648.8102462 mgr.a (mgr.14152) 1018 : cluster 0 pgmap v896: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:50.846 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:50 smithi103 bash[27315]: cluster 1689213648.8102462 mgr.a (mgr.14152) 1018 : cluster 0 pgmap v896: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:52.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:52 smithi022 bash[26979]: cluster 1689213650.8106558 mgr.a (mgr.14152) 1019 : cluster 0 pgmap v897: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:52.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:52 smithi154 bash[27744]: cluster 1689213650.8106558 mgr.a (mgr.14152) 1019 : cluster 0 pgmap v897: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:52.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:52 smithi137 bash[27262]: cluster 1689213650.8106558 mgr.a (mgr.14152) 1019 : cluster 0 pgmap v897: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:52.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:52 smithi103 bash[27315]: cluster 1689213650.8106558 mgr.a (mgr.14152) 1019 : cluster 0 pgmap v897: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:52.886 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:52 smithi084 bash[27323]: cluster 1689213650.8106558 mgr.a (mgr.14152) 1019 : cluster 0 pgmap v897: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:53.063 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:00:53.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:53 smithi022 bash[26979]: audit 1689213653.078743 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.22:0/2901747854' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:53.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:53 smithi154 bash[27744]: audit 1689213653.078743 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.22:0/2901747854' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:53.779 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:00:53.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:53 smithi137 bash[27262]: audit 1689213653.078743 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.22:0/2901747854' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:53.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:53 smithi103 bash[27315]: audit 1689213653.078743 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.22:0/2901747854' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:53.886 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:53 smithi084 bash[27323]: audit 1689213653.078743 mon.c (mon.2) 19 : audit 0 from='client.? 172.21.15.22:0/2901747854' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:00:54.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:54 smithi022 bash[26979]: cluster 1689213652.8111086 mgr.a (mgr.14152) 1020 : cluster 0 pgmap v898: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:54.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:54 smithi154 bash[27744]: cluster 1689213652.8111086 mgr.a (mgr.14152) 1020 : cluster 0 pgmap v898: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:54.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:00:54.796 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:54 smithi137 bash[27262]: cluster 1689213652.8111086 mgr.a (mgr.14152) 1020 : cluster 0 pgmap v898: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:54.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:54 smithi103 bash[27315]: cluster 1689213652.8111086 mgr.a (mgr.14152) 1020 : cluster 0 pgmap v898: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:54.886 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:54 smithi084 bash[27323]: cluster 1689213652.8111086 mgr.a (mgr.14152) 1020 : cluster 0 pgmap v898: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:56.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:56 smithi154 bash[27744]: cluster 1689213654.811596 mgr.a (mgr.14152) 1021 : cluster 0 pgmap v899: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:56.797 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:56 smithi137 bash[27262]: cluster 1689213654.811596 mgr.a (mgr.14152) 1021 : cluster 0 pgmap v899: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:56.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:56 smithi103 bash[27315]: cluster 1689213654.811596 mgr.a (mgr.14152) 1021 : cluster 0 pgmap v899: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:56.886 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:56 smithi084 bash[27323]: cluster 1689213654.811596 mgr.a (mgr.14152) 1021 : cluster 0 pgmap v899: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:56.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:56 smithi022 bash[26979]: cluster 1689213654.811596 mgr.a (mgr.14152) 1021 : cluster 0 pgmap v899: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:57.750 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:57 smithi154 bash[27744]: cluster 1689213656.8121874 mgr.a (mgr.14152) 1022 : cluster 0 pgmap v900: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:57.797 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:57 smithi137 bash[27262]: cluster 1689213656.8121874 mgr.a (mgr.14152) 1022 : cluster 0 pgmap v900: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:57.847 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:57 smithi103 bash[27315]: cluster 1689213656.8121874 mgr.a (mgr.14152) 1022 : cluster 0 pgmap v900: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:57.886 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:57 smithi084 bash[27323]: cluster 1689213656.8121874 mgr.a (mgr.14152) 1022 : cluster 0 pgmap v900: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:57.903 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:57 smithi022 bash[26979]: cluster 1689213656.8121874 mgr.a (mgr.14152) 1022 : cluster 0 pgmap v900: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:00:59.481 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:00.136 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:00:59 smithi084 bash[27323]: cluster 1689213658.812709 mgr.a (mgr.14152) 1023 : cluster 0 pgmap v901: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:00.153 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:00:59 smithi022 bash[26979]: cluster 1689213658.812709 mgr.a (mgr.14152) 1023 : cluster 0 pgmap v901: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:00.250 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:00:59 smithi154 bash[27744]: cluster 1689213658.812709 mgr.a (mgr.14152) 1023 : cluster 0 pgmap v901: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:00.297 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:00:59 smithi137 bash[27262]: cluster 1689213658.812709 mgr.a (mgr.14152) 1023 : cluster 0 pgmap v901: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:00.347 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:00:59 smithi103 bash[27315]: cluster 1689213658.812709 mgr.a (mgr.14152) 1023 : cluster 0 pgmap v901: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:02 smithi022 bash[26979]: cluster 1689213660.8133059 mgr.a (mgr.14152) 1024 : cluster 0 pgmap v902: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:02.386 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:02 smithi084 bash[27323]: cluster 1689213660.8133059 mgr.a (mgr.14152) 1024 : cluster 0 pgmap v902: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:02.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:02 smithi154 bash[27744]: cluster 1689213660.8133059 mgr.a (mgr.14152) 1024 : cluster 0 pgmap v902: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:02.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:02 smithi137 bash[27262]: cluster 1689213660.8133059 mgr.a (mgr.14152) 1024 : cluster 0 pgmap v902: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:02.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:02 smithi103 bash[27315]: cluster 1689213660.8133059 mgr.a (mgr.14152) 1024 : cluster 0 pgmap v902: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:02.762 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:01:03.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:03 smithi084 bash[27323]: audit 1689213662.7744436 mon.a (mon.0) 1158 : audit 0 from='client.? 172.21.15.22:0/3792965013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:03.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:03 smithi022 bash[26979]: audit 1689213662.7744436 mon.a (mon.0) 1158 : audit 0 from='client.? 172.21.15.22:0/3792965013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:03.452 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:01:03.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:03 smithi154 bash[27744]: audit 1689213662.7744436 mon.a (mon.0) 1158 : audit 0 from='client.? 172.21.15.22:0/3792965013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:03.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:03 smithi137 bash[27262]: audit 1689213662.7744436 mon.a (mon.0) 1158 : audit 0 from='client.? 172.21.15.22:0/3792965013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:03.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:03 smithi103 bash[27315]: audit 1689213662.7744436 mon.a (mon.0) 1158 : audit 0 from='client.? 172.21.15.22:0/3792965013' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:04.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:04 smithi084 bash[27323]: cluster 1689213662.8138826 mgr.a (mgr.14152) 1025 : cluster 0 pgmap v903: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:04.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:04 smithi022 bash[26979]: cluster 1689213662.8138826 mgr.a (mgr.14152) 1025 : cluster 0 pgmap v903: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:04.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:01:04.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:04 smithi154 bash[27744]: cluster 1689213662.8138826 mgr.a (mgr.14152) 1025 : cluster 0 pgmap v903: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:04.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:04 smithi137 bash[27262]: cluster 1689213662.8138826 mgr.a (mgr.14152) 1025 : cluster 0 pgmap v903: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:04.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:04 smithi103 bash[27315]: cluster 1689213662.8138826 mgr.a (mgr.14152) 1025 : cluster 0 pgmap v903: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:06.387 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:06 smithi084 bash[27323]: cluster 1689213664.8143988 mgr.a (mgr.14152) 1026 : cluster 0 pgmap v904: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:06.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:06 smithi022 bash[26979]: cluster 1689213664.8143988 mgr.a (mgr.14152) 1026 : cluster 0 pgmap v904: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:06.500 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:06 smithi154 bash[27744]: cluster 1689213664.8143988 mgr.a (mgr.14152) 1026 : cluster 0 pgmap v904: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:06.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:06 smithi137 bash[27262]: cluster 1689213664.8143988 mgr.a (mgr.14152) 1026 : cluster 0 pgmap v904: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:06.597 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:06 smithi103 bash[27315]: cluster 1689213664.8143988 mgr.a (mgr.14152) 1026 : cluster 0 pgmap v904: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:08.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:08 smithi022 bash[26979]: cluster 1689213666.814926 mgr.a (mgr.14152) 1027 : cluster 0 pgmap v905: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:08.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:08 smithi154 bash[27744]: cluster 1689213666.814926 mgr.a (mgr.14152) 1027 : cluster 0 pgmap v905: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:08.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:08 smithi137 bash[27262]: cluster 1689213666.814926 mgr.a (mgr.14152) 1027 : cluster 0 pgmap v905: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:08.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:08 smithi103 bash[27315]: cluster 1689213666.814926 mgr.a (mgr.14152) 1027 : cluster 0 pgmap v905: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:08.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:08 smithi084 bash[27323]: cluster 1689213666.814926 mgr.a (mgr.14152) 1027 : cluster 0 pgmap v905: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:09.150 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:10.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:10 smithi022 bash[26979]: cluster 1689213668.8154151 mgr.a (mgr.14152) 1028 : cluster 0 pgmap v906: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:10.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:10 smithi154 bash[27744]: cluster 1689213668.8154151 mgr.a (mgr.14152) 1028 : cluster 0 pgmap v906: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:10.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:10 smithi137 bash[27262]: cluster 1689213668.8154151 mgr.a (mgr.14152) 1028 : cluster 0 pgmap v906: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:10.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:10 smithi103 bash[27315]: cluster 1689213668.8154151 mgr.a (mgr.14152) 1028 : cluster 0 pgmap v906: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:10.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:10 smithi084 bash[27323]: cluster 1689213668.8154151 mgr.a (mgr.14152) 1028 : cluster 0 pgmap v906: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:12.403 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:12 smithi022 bash[26979]: cluster 1689213670.8158937 mgr.a (mgr.14152) 1029 : cluster 0 pgmap v907: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:12.469 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:01:12.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:12 smithi154 bash[27744]: cluster 1689213670.8158937 mgr.a (mgr.14152) 1029 : cluster 0 pgmap v907: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:12.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:12 smithi137 bash[27262]: cluster 1689213670.8158937 mgr.a (mgr.14152) 1029 : cluster 0 pgmap v907: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:12.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:12 smithi103 bash[27315]: cluster 1689213670.8158937 mgr.a (mgr.14152) 1029 : cluster 0 pgmap v907: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:12.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:12 smithi084 bash[27323]: cluster 1689213670.8158937 mgr.a (mgr.14152) 1029 : cluster 0 pgmap v907: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:13.203 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:01:13.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:13 smithi154 bash[27744]: audit 1689213672.4813006 mon.a (mon.0) 1159 : audit 0 from='client.? 172.21.15.22:0/589621663' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:13.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:13 smithi154 bash[27744]: audit 1689213672.9742935 mon.a (mon.0) 1160 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:01:13.547 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:13 smithi137 bash[27262]: audit 1689213672.4813006 mon.a (mon.0) 1159 : audit 0 from='client.? 172.21.15.22:0/589621663' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:13.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:13 smithi137 bash[27262]: audit 1689213672.9742935 mon.a (mon.0) 1160 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:01:13.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:13 smithi103 bash[27315]: audit 1689213672.4813006 mon.a (mon.0) 1159 : audit 0 from='client.? 172.21.15.22:0/589621663' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:13.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:13 smithi103 bash[27315]: audit 1689213672.9742935 mon.a (mon.0) 1160 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:01:13.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:13 smithi084 bash[27323]: audit 1689213672.4813006 mon.a (mon.0) 1159 : audit 0 from='client.? 172.21.15.22:0/589621663' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:13.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:13 smithi084 bash[27323]: audit 1689213672.9742935 mon.a (mon.0) 1160 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:01:13.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:13 smithi022 bash[26979]: audit 1689213672.4813006 mon.a (mon.0) 1159 : audit 0 from='client.? 172.21.15.22:0/589621663' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:13.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:13 smithi022 bash[26979]: audit 1689213672.9742935 mon.a (mon.0) 1160 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:01:14.205 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:01:14.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:14 smithi154 bash[27744]: cluster 1689213672.816431 mgr.a (mgr.14152) 1030 : cluster 0 pgmap v908: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:14.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:14 smithi154 bash[27744]: audit 1689213673.8138611 mon.a (mon.0) 1161 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:01:14.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:14 smithi154 bash[27744]: audit 1689213673.8156796 mon.a (mon.0) 1162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:01:14.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:14 smithi154 bash[27744]: audit 1689213673.8278127 mon.a (mon.0) 1163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:01:14.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:14 smithi137 bash[27262]: cluster 1689213672.816431 mgr.a (mgr.14152) 1030 : cluster 0 pgmap v908: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:14.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:14 smithi137 bash[27262]: audit 1689213673.8138611 mon.a (mon.0) 1161 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:01:14.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:14 smithi137 bash[27262]: audit 1689213673.8156796 mon.a (mon.0) 1162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:01:14.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:14 smithi137 bash[27262]: audit 1689213673.8278127 mon.a (mon.0) 1163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:01:14.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:14 smithi103 bash[27315]: cluster 1689213672.816431 mgr.a (mgr.14152) 1030 : cluster 0 pgmap v908: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:14.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:14 smithi103 bash[27315]: audit 1689213673.8138611 mon.a (mon.0) 1161 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:01:14.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:14 smithi103 bash[27315]: audit 1689213673.8156796 mon.a (mon.0) 1162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:01:14.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:14 smithi103 bash[27315]: audit 1689213673.8278127 mon.a (mon.0) 1163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:01:14.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:14 smithi084 bash[27323]: cluster 1689213672.816431 mgr.a (mgr.14152) 1030 : cluster 0 pgmap v908: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:14.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:14 smithi084 bash[27323]: audit 1689213673.8138611 mon.a (mon.0) 1161 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:01:14.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:14 smithi084 bash[27323]: audit 1689213673.8156796 mon.a (mon.0) 1162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:01:14.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:14 smithi084 bash[27323]: audit 1689213673.8278127 mon.a (mon.0) 1163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:01:14.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:14 smithi022 bash[26979]: cluster 1689213672.816431 mgr.a (mgr.14152) 1030 : cluster 0 pgmap v908: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:14.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:14 smithi022 bash[26979]: audit 1689213673.8138611 mon.a (mon.0) 1161 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:01:14.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:14 smithi022 bash[26979]: audit 1689213673.8156796 mon.a (mon.0) 1162 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:01:14.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:14 smithi022 bash[26979]: audit 1689213673.8278127 mon.a (mon.0) 1163 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:01:15.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:15 smithi154 bash[27744]: cluster 1689213673.8192062 mgr.a (mgr.14152) 1031 : cluster 0 pgmap v909: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:15 smithi154 bash[27744]: cluster 1689213673.8195689 mgr.a (mgr.14152) 1032 : cluster 0 pgmap v910: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:15 smithi137 bash[27262]: cluster 1689213673.8192062 mgr.a (mgr.14152) 1031 : cluster 0 pgmap v909: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:15 smithi137 bash[27262]: cluster 1689213673.8195689 mgr.a (mgr.14152) 1032 : cluster 0 pgmap v910: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:15 smithi103 bash[27315]: cluster 1689213673.8192062 mgr.a (mgr.14152) 1031 : cluster 0 pgmap v909: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:15 smithi103 bash[27315]: cluster 1689213673.8195689 mgr.a (mgr.14152) 1032 : cluster 0 pgmap v910: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:15 smithi084 bash[27323]: cluster 1689213673.8192062 mgr.a (mgr.14152) 1031 : cluster 0 pgmap v909: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:15 smithi084 bash[27323]: cluster 1689213673.8195689 mgr.a (mgr.14152) 1032 : cluster 0 pgmap v910: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:15 smithi022 bash[26979]: cluster 1689213673.8192062 mgr.a (mgr.14152) 1031 : cluster 0 pgmap v909: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:15.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:15 smithi022 bash[26979]: cluster 1689213673.8195689 mgr.a (mgr.14152) 1032 : cluster 0 pgmap v910: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:17.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:17 smithi154 bash[27744]: cluster 1689213675.8200471 mgr.a (mgr.14152) 1033 : cluster 0 pgmap v911: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:17.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:17 smithi137 bash[27262]: cluster 1689213675.8200471 mgr.a (mgr.14152) 1033 : cluster 0 pgmap v911: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:17.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:17 smithi103 bash[27315]: cluster 1689213675.8200471 mgr.a (mgr.14152) 1033 : cluster 0 pgmap v911: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:17.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:17 smithi084 bash[27323]: cluster 1689213675.8200471 mgr.a (mgr.14152) 1033 : cluster 0 pgmap v911: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:17.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:17 smithi022 bash[26979]: cluster 1689213675.8200471 mgr.a (mgr.14152) 1033 : cluster 0 pgmap v911: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:18.902 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:19.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:19 smithi022 bash[26979]: cluster 1689213677.8205545 mgr.a (mgr.14152) 1034 : cluster 0 pgmap v912: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:19.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:19 smithi154 bash[27744]: cluster 1689213677.8205545 mgr.a (mgr.14152) 1034 : cluster 0 pgmap v912: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:19.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:19 smithi137 bash[27262]: cluster 1689213677.8205545 mgr.a (mgr.14152) 1034 : cluster 0 pgmap v912: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:19.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:19 smithi103 bash[27315]: cluster 1689213677.8205545 mgr.a (mgr.14152) 1034 : cluster 0 pgmap v912: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:19.637 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:19 smithi084 bash[27323]: cluster 1689213677.8205545 mgr.a (mgr.14152) 1034 : cluster 0 pgmap v912: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:21.501 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:21 smithi154 bash[27744]: cluster 1689213679.821063 mgr.a (mgr.14152) 1035 : cluster 0 pgmap v913: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:21.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:21 smithi137 bash[27262]: cluster 1689213679.821063 mgr.a (mgr.14152) 1035 : cluster 0 pgmap v913: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:21.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:21 smithi103 bash[27315]: cluster 1689213679.821063 mgr.a (mgr.14152) 1035 : cluster 0 pgmap v913: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:21.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:21 smithi084 bash[27323]: cluster 1689213679.821063 mgr.a (mgr.14152) 1035 : cluster 0 pgmap v913: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:21.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:21 smithi022 bash[26979]: cluster 1689213679.821063 mgr.a (mgr.14152) 1035 : cluster 0 pgmap v913: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:22.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:01:22.943 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:01:23.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:23 smithi022 bash[26979]: cluster 1689213681.82159 mgr.a (mgr.14152) 1036 : cluster 0 pgmap v914: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:23.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:23 smithi022 bash[26979]: audit 1689213682.245767 mon.b (mon.4) 28 : audit 0 from='client.? 172.21.15.22:0/1502725842' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:23.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:23 smithi154 bash[27744]: cluster 1689213681.82159 mgr.a (mgr.14152) 1036 : cluster 0 pgmap v914: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:23.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:23 smithi154 bash[27744]: audit 1689213682.245767 mon.b (mon.4) 28 : audit 0 from='client.? 172.21.15.22:0/1502725842' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:23.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:23 smithi137 bash[27262]: cluster 1689213681.82159 mgr.a (mgr.14152) 1036 : cluster 0 pgmap v914: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:23.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:23 smithi137 bash[27262]: audit 1689213682.245767 mon.b (mon.4) 28 : audit 0 from='client.? 172.21.15.22:0/1502725842' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:23.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:23 smithi103 bash[27315]: cluster 1689213681.82159 mgr.a (mgr.14152) 1036 : cluster 0 pgmap v914: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:23.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:23 smithi103 bash[27315]: audit 1689213682.245767 mon.b (mon.4) 28 : audit 0 from='client.? 172.21.15.22:0/1502725842' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:23.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:23 smithi084 bash[27323]: cluster 1689213681.82159 mgr.a (mgr.14152) 1036 : cluster 0 pgmap v914: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:23.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:23 smithi084 bash[27323]: audit 1689213682.245767 mon.b (mon.4) 28 : audit 0 from='client.? 172.21.15.22:0/1502725842' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:23.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:01:25.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:25 smithi154 bash[27744]: cluster 1689213683.82208 mgr.a (mgr.14152) 1037 : cluster 0 pgmap v915: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:25.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:25 smithi137 bash[27262]: cluster 1689213683.82208 mgr.a (mgr.14152) 1037 : cluster 0 pgmap v915: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:25.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:25 smithi103 bash[27315]: cluster 1689213683.82208 mgr.a (mgr.14152) 1037 : cluster 0 pgmap v915: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:25.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:25 smithi084 bash[27323]: cluster 1689213683.82208 mgr.a (mgr.14152) 1037 : cluster 0 pgmap v915: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:25.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:25 smithi022 bash[26979]: cluster 1689213683.82208 mgr.a (mgr.14152) 1037 : cluster 0 pgmap v915: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:27.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:27 smithi154 bash[27744]: cluster 1689213685.8225837 mgr.a (mgr.14152) 1038 : cluster 0 pgmap v916: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:27.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:27 smithi137 bash[27262]: cluster 1689213685.8225837 mgr.a (mgr.14152) 1038 : cluster 0 pgmap v916: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:27.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:27 smithi103 bash[27315]: cluster 1689213685.8225837 mgr.a (mgr.14152) 1038 : cluster 0 pgmap v916: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:27.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:27 smithi084 bash[27323]: cluster 1689213685.8225837 mgr.a (mgr.14152) 1038 : cluster 0 pgmap v916: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:27.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:27 smithi022 bash[26979]: cluster 1689213685.8225837 mgr.a (mgr.14152) 1038 : cluster 0 pgmap v916: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:28.641 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:29.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:29 smithi154 bash[27744]: cluster 1689213687.8231273 mgr.a (mgr.14152) 1039 : cluster 0 pgmap v917: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:29.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:29 smithi137 bash[27262]: cluster 1689213687.8231273 mgr.a (mgr.14152) 1039 : cluster 0 pgmap v917: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:29.598 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:29 smithi103 bash[27315]: cluster 1689213687.8231273 mgr.a (mgr.14152) 1039 : cluster 0 pgmap v917: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:29.606 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:29 smithi022 bash[26979]: cluster 1689213687.8231273 mgr.a (mgr.14152) 1039 : cluster 0 pgmap v917: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:29.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:29 smithi084 bash[27323]: cluster 1689213687.8231273 mgr.a (mgr.14152) 1039 : cluster 0 pgmap v917: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:31.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:31 smithi154 bash[27744]: cluster 1689213689.8236568 mgr.a (mgr.14152) 1040 : cluster 0 pgmap v918: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:31.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:31 smithi137 bash[27262]: cluster 1689213689.8236568 mgr.a (mgr.14152) 1040 : cluster 0 pgmap v918: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:31.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:31 smithi103 bash[27315]: cluster 1689213689.8236568 mgr.a (mgr.14152) 1040 : cluster 0 pgmap v918: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:31.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:31 smithi084 bash[27323]: cluster 1689213689.8236568 mgr.a (mgr.14152) 1040 : cluster 0 pgmap v918: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:31.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:31 smithi022 bash[26979]: cluster 1689213689.8236568 mgr.a (mgr.14152) 1040 : cluster 0 pgmap v918: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:31.776 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:01:32.404 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:32 smithi022 bash[26979]: audit 1689213691.787209 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.22:0/3339609999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:32.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:32 smithi154 bash[27744]: audit 1689213691.787209 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.22:0/3339609999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:32.517 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:01:32.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:32 smithi137 bash[27262]: audit 1689213691.787209 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.22:0/3339609999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:32.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:32 smithi103 bash[27315]: audit 1689213691.787209 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.22:0/3339609999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:32.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:32 smithi084 bash[27323]: audit 1689213691.787209 mon.a (mon.0) 1164 : audit 0 from='client.? 172.21.15.22:0/3339609999' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:33.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:33 smithi154 bash[27744]: cluster 1689213691.8241222 mgr.a (mgr.14152) 1041 : cluster 0 pgmap v919: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:33.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:01:33.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:33 smithi022 bash[26979]: cluster 1689213691.8241222 mgr.a (mgr.14152) 1041 : cluster 0 pgmap v919: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:33.548 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:33 smithi137 bash[27262]: cluster 1689213691.8241222 mgr.a (mgr.14152) 1041 : cluster 0 pgmap v919: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:33.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:33 smithi103 bash[27315]: cluster 1689213691.8241222 mgr.a (mgr.14152) 1041 : cluster 0 pgmap v919: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:33.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:33 smithi084 bash[27323]: cluster 1689213691.8241222 mgr.a (mgr.14152) 1041 : cluster 0 pgmap v919: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:35.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:35 smithi154 bash[27744]: cluster 1689213693.824635 mgr.a (mgr.14152) 1042 : cluster 0 pgmap v920: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:35.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:35 smithi137 bash[27262]: cluster 1689213693.824635 mgr.a (mgr.14152) 1042 : cluster 0 pgmap v920: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:35.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:35 smithi103 bash[27315]: cluster 1689213693.824635 mgr.a (mgr.14152) 1042 : cluster 0 pgmap v920: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:35.638 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:35 smithi084 bash[27323]: cluster 1689213693.824635 mgr.a (mgr.14152) 1042 : cluster 0 pgmap v920: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:35.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:35 smithi022 bash[26979]: cluster 1689213693.824635 mgr.a (mgr.14152) 1042 : cluster 0 pgmap v920: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:37.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:37 smithi154 bash[27744]: cluster 1689213695.8251662 mgr.a (mgr.14152) 1043 : cluster 0 pgmap v921: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:37.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:37 smithi137 bash[27262]: cluster 1689213695.8251662 mgr.a (mgr.14152) 1043 : cluster 0 pgmap v921: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:37.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:37 smithi103 bash[27315]: cluster 1689213695.8251662 mgr.a (mgr.14152) 1043 : cluster 0 pgmap v921: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:37.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:37 smithi084 bash[27323]: cluster 1689213695.8251662 mgr.a (mgr.14152) 1043 : cluster 0 pgmap v921: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:37.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:37 smithi022 bash[26979]: cluster 1689213695.8251662 mgr.a (mgr.14152) 1043 : cluster 0 pgmap v921: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:38.218 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:39.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:39 smithi154 bash[27744]: cluster 1689213697.8256814 mgr.a (mgr.14152) 1044 : cluster 0 pgmap v922: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:39.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:39 smithi022 bash[26979]: cluster 1689213697.8256814 mgr.a (mgr.14152) 1044 : cluster 0 pgmap v922: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:39.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:39 smithi137 bash[27262]: cluster 1689213697.8256814 mgr.a (mgr.14152) 1044 : cluster 0 pgmap v922: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:39.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:39 smithi103 bash[27315]: cluster 1689213697.8256814 mgr.a (mgr.14152) 1044 : cluster 0 pgmap v922: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:39.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:39 smithi084 bash[27323]: cluster 1689213697.8256814 mgr.a (mgr.14152) 1044 : cluster 0 pgmap v922: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:41.422 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:01:41.486 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:41 smithi022 bash[26979]: cluster 1689213699.8262334 mgr.a (mgr.14152) 1045 : cluster 0 pgmap v923: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:41.502 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:41 smithi154 bash[27744]: cluster 1689213699.8262334 mgr.a (mgr.14152) 1045 : cluster 0 pgmap v923: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:41.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:41 smithi137 bash[27262]: cluster 1689213699.8262334 mgr.a (mgr.14152) 1045 : cluster 0 pgmap v923: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:41.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:41 smithi103 bash[27315]: cluster 1689213699.8262334 mgr.a (mgr.14152) 1045 : cluster 0 pgmap v923: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:41.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:41 smithi084 bash[27323]: cluster 1689213699.8262334 mgr.a (mgr.14152) 1045 : cluster 0 pgmap v923: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:42.173 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:01:42.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:42 smithi154 bash[27744]: audit 1689213701.4348137 mon.b (mon.4) 29 : audit 0 from='client.? 172.21.15.22:0/2964827852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:42.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:42 smithi137 bash[27262]: audit 1689213701.4348137 mon.b (mon.4) 29 : audit 0 from='client.? 172.21.15.22:0/2964827852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:42.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:42 smithi103 bash[27315]: audit 1689213701.4348137 mon.b (mon.4) 29 : audit 0 from='client.? 172.21.15.22:0/2964827852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:42.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:42 smithi084 bash[27323]: audit 1689213701.4348137 mon.b (mon.4) 29 : audit 0 from='client.? 172.21.15.22:0/2964827852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:42.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:42 smithi022 bash[26979]: audit 1689213701.4348137 mon.b (mon.4) 29 : audit 0 from='client.? 172.21.15.22:0/2964827852' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:43.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:01:43.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:43 smithi154 bash[27744]: cluster 1689213701.8267741 mgr.a (mgr.14152) 1046 : cluster 0 pgmap v924: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:43.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:43 smithi137 bash[27262]: cluster 1689213701.8267741 mgr.a (mgr.14152) 1046 : cluster 0 pgmap v924: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:43.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:43 smithi103 bash[27315]: cluster 1689213701.8267741 mgr.a (mgr.14152) 1046 : cluster 0 pgmap v924: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:43.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:43 smithi084 bash[27323]: cluster 1689213701.8267741 mgr.a (mgr.14152) 1046 : cluster 0 pgmap v924: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:43.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:43 smithi022 bash[26979]: cluster 1689213701.8267741 mgr.a (mgr.14152) 1046 : cluster 0 pgmap v924: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:45.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:45 smithi154 bash[27744]: cluster 1689213703.8273046 mgr.a (mgr.14152) 1047 : cluster 0 pgmap v925: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:45.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:45 smithi137 bash[27262]: cluster 1689213703.8273046 mgr.a (mgr.14152) 1047 : cluster 0 pgmap v925: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:45.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:45 smithi103 bash[27315]: cluster 1689213703.8273046 mgr.a (mgr.14152) 1047 : cluster 0 pgmap v925: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:45.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:45 smithi084 bash[27323]: cluster 1689213703.8273046 mgr.a (mgr.14152) 1047 : cluster 0 pgmap v925: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:45.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:45 smithi022 bash[26979]: cluster 1689213703.8273046 mgr.a (mgr.14152) 1047 : cluster 0 pgmap v925: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:47.503 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:47 smithi154 bash[27744]: cluster 1689213705.8278382 mgr.a (mgr.14152) 1048 : cluster 0 pgmap v926: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:47.549 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:47 smithi137 bash[27262]: cluster 1689213705.8278382 mgr.a (mgr.14152) 1048 : cluster 0 pgmap v926: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:47.599 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:47 smithi103 bash[27315]: cluster 1689213705.8278382 mgr.a (mgr.14152) 1048 : cluster 0 pgmap v926: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:47.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:47 smithi084 bash[27323]: cluster 1689213705.8278382 mgr.a (mgr.14152) 1048 : cluster 0 pgmap v926: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:47 smithi022 bash[26979]: cluster 1689213705.8278382 mgr.a (mgr.14152) 1048 : cluster 0 pgmap v926: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:49.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:49 smithi137 bash[27262]: cluster 1689213707.828352 mgr.a (mgr.14152) 1049 : cluster 0 pgmap v927: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:49.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:49 smithi103 bash[27315]: cluster 1689213707.828352 mgr.a (mgr.14152) 1049 : cluster 0 pgmap v927: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:49.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:49 smithi084 bash[27323]: cluster 1689213707.828352 mgr.a (mgr.14152) 1049 : cluster 0 pgmap v927: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:49.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:49 smithi022 bash[26979]: cluster 1689213707.828352 mgr.a (mgr.14152) 1049 : cluster 0 pgmap v927: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:49.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:49 smithi154 bash[27744]: cluster 1689213707.828352 mgr.a (mgr.14152) 1049 : cluster 0 pgmap v927: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:51.281 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:01:51.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:51 smithi137 bash[27262]: cluster 1689213709.828842 mgr.a (mgr.14152) 1050 : cluster 0 pgmap v928: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:51.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:51 smithi103 bash[27315]: cluster 1689213709.828842 mgr.a (mgr.14152) 1050 : cluster 0 pgmap v928: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:51.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:51 smithi084 bash[27323]: cluster 1689213709.828842 mgr.a (mgr.14152) 1050 : cluster 0 pgmap v928: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:51.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:51 smithi022 bash[26979]: cluster 1689213709.828842 mgr.a (mgr.14152) 1050 : cluster 0 pgmap v928: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:51.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:51 smithi154 bash[27744]: cluster 1689213709.828842 mgr.a (mgr.14152) 1050 : cluster 0 pgmap v928: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:51.996 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:01:52.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:52 smithi137 bash[27262]: audit 1689213711.2905915 mon.a (mon.0) 1165 : audit 0 from='client.? 172.21.15.22:0/1811924727' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:52.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:52 smithi103 bash[27315]: audit 1689213711.2905915 mon.a (mon.0) 1165 : audit 0 from='client.? 172.21.15.22:0/1811924727' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:52.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:52 smithi084 bash[27323]: audit 1689213711.2905915 mon.a (mon.0) 1165 : audit 0 from='client.? 172.21.15.22:0/1811924727' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:52.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:52 smithi022 bash[26979]: audit 1689213711.2905915 mon.a (mon.0) 1165 : audit 0 from='client.? 172.21.15.22:0/1811924727' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:52.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:52 smithi154 bash[27744]: audit 1689213711.2905915 mon.a (mon.0) 1165 : audit 0 from='client.? 172.21.15.22:0/1811924727' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:01:52.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:01:53.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:53 smithi137 bash[27262]: cluster 1689213711.829404 mgr.a (mgr.14152) 1051 : cluster 0 pgmap v929: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:53.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:53 smithi103 bash[27315]: cluster 1689213711.829404 mgr.a (mgr.14152) 1051 : cluster 0 pgmap v929: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:53.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:53 smithi084 bash[27323]: cluster 1689213711.829404 mgr.a (mgr.14152) 1051 : cluster 0 pgmap v929: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:53.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:53 smithi022 bash[26979]: cluster 1689213711.829404 mgr.a (mgr.14152) 1051 : cluster 0 pgmap v929: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:53.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:53 smithi154 bash[27744]: cluster 1689213711.829404 mgr.a (mgr.14152) 1051 : cluster 0 pgmap v929: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:55.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:55 smithi137 bash[27262]: cluster 1689213713.8299134 mgr.a (mgr.14152) 1052 : cluster 0 pgmap v930: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:55.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:55 smithi103 bash[27315]: cluster 1689213713.8299134 mgr.a (mgr.14152) 1052 : cluster 0 pgmap v930: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:55.639 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:55 smithi084 bash[27323]: cluster 1689213713.8299134 mgr.a (mgr.14152) 1052 : cluster 0 pgmap v930: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:55.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:55 smithi022 bash[26979]: cluster 1689213713.8299134 mgr.a (mgr.14152) 1052 : cluster 0 pgmap v930: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:55.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:55 smithi154 bash[27744]: cluster 1689213713.8299134 mgr.a (mgr.14152) 1052 : cluster 0 pgmap v930: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:57.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:57 smithi137 bash[27262]: cluster 1689213715.8303828 mgr.a (mgr.14152) 1053 : cluster 0 pgmap v931: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:57.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:57 smithi103 bash[27315]: cluster 1689213715.8303828 mgr.a (mgr.14152) 1053 : cluster 0 pgmap v931: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:57.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:57 smithi084 bash[27323]: cluster 1689213715.8303828 mgr.a (mgr.14152) 1053 : cluster 0 pgmap v931: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:57.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:57 smithi022 bash[26979]: cluster 1689213715.8303828 mgr.a (mgr.14152) 1053 : cluster 0 pgmap v931: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:57.692 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:01:57.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:57 smithi154 bash[27744]: cluster 1689213715.8303828 mgr.a (mgr.14152) 1053 : cluster 0 pgmap v931: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:59.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:01:59 smithi022 bash[26979]: cluster 1689213717.8309455 mgr.a (mgr.14152) 1054 : cluster 0 pgmap v932: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:59.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:01:59 smithi137 bash[27262]: cluster 1689213717.8309455 mgr.a (mgr.14152) 1054 : cluster 0 pgmap v932: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:59.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:01:59 smithi103 bash[27315]: cluster 1689213717.8309455 mgr.a (mgr.14152) 1054 : cluster 0 pgmap v932: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:59.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:01:59 smithi084 bash[27323]: cluster 1689213717.8309455 mgr.a (mgr.14152) 1054 : cluster 0 pgmap v932: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:01:59.753 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:01:59 smithi154 bash[27744]: cluster 1689213717.8309455 mgr.a (mgr.14152) 1054 : cluster 0 pgmap v932: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:01.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:01 smithi022 bash[26979]: cluster 1689213719.831486 mgr.a (mgr.14152) 1055 : cluster 0 pgmap v933: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:01.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:01 smithi022 bash[26979]: audit 1689213721.021161 mon.a (mon.0) 1166 : audit 0 from='client.? 172.21.15.22:0/3675030159' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:01.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:01 smithi137 bash[27262]: cluster 1689213719.831486 mgr.a (mgr.14152) 1055 : cluster 0 pgmap v933: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:01.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:01 smithi137 bash[27262]: audit 1689213721.021161 mon.a (mon.0) 1166 : audit 0 from='client.? 172.21.15.22:0/3675030159' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:01.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:01 smithi103 bash[27315]: cluster 1689213719.831486 mgr.a (mgr.14152) 1055 : cluster 0 pgmap v933: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:01.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:01 smithi103 bash[27315]: audit 1689213721.021161 mon.a (mon.0) 1166 : audit 0 from='client.? 172.21.15.22:0/3675030159' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:01.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:01 smithi084 bash[27323]: cluster 1689213719.831486 mgr.a (mgr.14152) 1055 : cluster 0 pgmap v933: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:01.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:01 smithi084 bash[27323]: audit 1689213721.021161 mon.a (mon.0) 1166 : audit 0 from='client.? 172.21.15.22:0/3675030159' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:01.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:01 smithi154 bash[27744]: cluster 1689213719.831486 mgr.a (mgr.14152) 1055 : cluster 0 pgmap v933: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:01.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:01 smithi154 bash[27744]: audit 1689213721.021161 mon.a (mon.0) 1166 : audit 0 from='client.? 172.21.15.22:0/3675030159' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:01.761 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:02:02.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:02:03.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:03 smithi137 bash[27262]: cluster 1689213721.832027 mgr.a (mgr.14152) 1056 : cluster 0 pgmap v934: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:03.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:03 smithi103 bash[27315]: cluster 1689213721.832027 mgr.a (mgr.14152) 1056 : cluster 0 pgmap v934: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:03.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:03 smithi084 bash[27323]: cluster 1689213721.832027 mgr.a (mgr.14152) 1056 : cluster 0 pgmap v934: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:03.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:03 smithi022 bash[26979]: cluster 1689213721.832027 mgr.a (mgr.14152) 1056 : cluster 0 pgmap v934: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:03.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:03 smithi154 bash[27744]: cluster 1689213721.832027 mgr.a (mgr.14152) 1056 : cluster 0 pgmap v934: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:05.550 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:05 smithi137 bash[27262]: cluster 1689213723.8325284 mgr.a (mgr.14152) 1057 : cluster 0 pgmap v935: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:05.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:05 smithi103 bash[27315]: cluster 1689213723.8325284 mgr.a (mgr.14152) 1057 : cluster 0 pgmap v935: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:05.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:05 smithi084 bash[27323]: cluster 1689213723.8325284 mgr.a (mgr.14152) 1057 : cluster 0 pgmap v935: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:05.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:05 smithi022 bash[26979]: cluster 1689213723.8325284 mgr.a (mgr.14152) 1057 : cluster 0 pgmap v935: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:05.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:05 smithi154 bash[27744]: cluster 1689213723.8325284 mgr.a (mgr.14152) 1057 : cluster 0 pgmap v935: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:07.459 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:02:07.600 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:07 smithi103 bash[27315]: cluster 1689213725.833033 mgr.a (mgr.14152) 1058 : cluster 0 pgmap v936: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:07.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:07 smithi084 bash[27323]: cluster 1689213725.833033 mgr.a (mgr.14152) 1058 : cluster 0 pgmap v936: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:07.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:07 smithi022 bash[26979]: cluster 1689213725.833033 mgr.a (mgr.14152) 1058 : cluster 0 pgmap v936: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:07.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:07 smithi154 bash[27744]: cluster 1689213725.833033 mgr.a (mgr.14152) 1058 : cluster 0 pgmap v936: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:07.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:07 smithi137 bash[27262]: cluster 1689213725.833033 mgr.a (mgr.14152) 1058 : cluster 0 pgmap v936: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:09.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:09 smithi103 bash[27315]: cluster 1689213727.8335838 mgr.a (mgr.14152) 1059 : cluster 0 pgmap v937: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:09.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:09 smithi084 bash[27323]: cluster 1689213727.8335838 mgr.a (mgr.14152) 1059 : cluster 0 pgmap v937: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:09.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:09 smithi022 bash[26979]: cluster 1689213727.8335838 mgr.a (mgr.14152) 1059 : cluster 0 pgmap v937: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:09.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:09 smithi154 bash[27744]: cluster 1689213727.8335838 mgr.a (mgr.14152) 1059 : cluster 0 pgmap v937: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:09.800 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:09 smithi137 bash[27262]: cluster 1689213727.8335838 mgr.a (mgr.14152) 1059 : cluster 0 pgmap v937: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:10.792 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:11.526 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:02:11.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:11 smithi103 bash[27315]: cluster 1689213729.834051 mgr.a (mgr.14152) 1060 : cluster 0 pgmap v938: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:11.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:11 smithi103 bash[27315]: audit 1689213730.8032103 mon.b (mon.4) 30 : audit 0 from='client.? 172.21.15.22:0/277793785' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:11.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:11 smithi084 bash[27323]: cluster 1689213729.834051 mgr.a (mgr.14152) 1060 : cluster 0 pgmap v938: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:11.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:11 smithi084 bash[27323]: audit 1689213730.8032103 mon.b (mon.4) 30 : audit 0 from='client.? 172.21.15.22:0/277793785' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:11.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:11 smithi022 bash[26979]: cluster 1689213729.834051 mgr.a (mgr.14152) 1060 : cluster 0 pgmap v938: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:11.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:11 smithi022 bash[26979]: audit 1689213730.8032103 mon.b (mon.4) 30 : audit 0 from='client.? 172.21.15.22:0/277793785' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:11.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:11 smithi154 bash[27744]: cluster 1689213729.834051 mgr.a (mgr.14152) 1060 : cluster 0 pgmap v938: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:11.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:11 smithi154 bash[27744]: audit 1689213730.8032103 mon.b (mon.4) 30 : audit 0 from='client.? 172.21.15.22:0/277793785' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:11.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:11 smithi137 bash[27262]: cluster 1689213729.834051 mgr.a (mgr.14152) 1060 : cluster 0 pgmap v938: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:11.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:11 smithi137 bash[27262]: audit 1689213730.8032103 mon.b (mon.4) 30 : audit 0 from='client.? 172.21.15.22:0/277793785' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:12.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:02:13.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:13 smithi103 bash[27315]: cluster 1689213731.8345387 mgr.a (mgr.14152) 1061 : cluster 0 pgmap v939: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:13.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:13 smithi084 bash[27323]: cluster 1689213731.8345387 mgr.a (mgr.14152) 1061 : cluster 0 pgmap v939: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:13.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:13 smithi022 bash[26979]: cluster 1689213731.8345387 mgr.a (mgr.14152) 1061 : cluster 0 pgmap v939: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:13.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:13 smithi154 bash[27744]: cluster 1689213731.8345387 mgr.a (mgr.14152) 1061 : cluster 0 pgmap v939: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:13.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:13 smithi137 bash[27262]: cluster 1689213731.8345387 mgr.a (mgr.14152) 1061 : cluster 0 pgmap v939: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:14.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:14 smithi103 bash[27315]: audit 1689213733.9973576 mon.a (mon.0) 1167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:02:14.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:14 smithi084 bash[27323]: audit 1689213733.9973576 mon.a (mon.0) 1167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:02:14.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:14 smithi022 bash[26979]: audit 1689213733.9973576 mon.a (mon.0) 1167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:02:14.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:14 smithi154 bash[27744]: audit 1689213733.9973576 mon.a (mon.0) 1167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:02:14.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:14 smithi137 bash[27262]: audit 1689213733.9973576 mon.a (mon.0) 1167 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:02:15.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:15 smithi103 bash[27315]: cluster 1689213733.8350585 mgr.a (mgr.14152) 1062 : cluster 0 pgmap v940: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:15.640 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:15 smithi084 bash[27323]: cluster 1689213733.8350585 mgr.a (mgr.14152) 1062 : cluster 0 pgmap v940: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:15.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:15 smithi022 bash[26979]: cluster 1689213733.8350585 mgr.a (mgr.14152) 1062 : cluster 0 pgmap v940: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:15.754 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:15 smithi154 bash[27744]: cluster 1689213733.8350585 mgr.a (mgr.14152) 1062 : cluster 0 pgmap v940: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:15.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:15 smithi137 bash[27262]: cluster 1689213733.8350585 mgr.a (mgr.14152) 1062 : cluster 0 pgmap v940: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:17.229 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:02:17.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:17 smithi103 bash[27315]: cluster 1689213735.8356545 mgr.a (mgr.14152) 1063 : cluster 0 pgmap v941: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:17.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:17 smithi084 bash[27323]: cluster 1689213735.8356545 mgr.a (mgr.14152) 1063 : cluster 0 pgmap v941: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:17.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:17 smithi022 bash[26979]: cluster 1689213735.8356545 mgr.a (mgr.14152) 1063 : cluster 0 pgmap v941: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:17.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:17 smithi154 bash[27744]: cluster 1689213735.8356545 mgr.a (mgr.14152) 1063 : cluster 0 pgmap v941: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:17.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:17 smithi137 bash[27262]: cluster 1689213735.8356545 mgr.a (mgr.14152) 1063 : cluster 0 pgmap v941: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:19.601 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:19 smithi103 bash[27315]: cluster 1689213737.8361306 mgr.a (mgr.14152) 1064 : cluster 0 pgmap v942: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:19.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:19 smithi084 bash[27323]: cluster 1689213737.8361306 mgr.a (mgr.14152) 1064 : cluster 0 pgmap v942: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:19.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:19 smithi022 bash[26979]: cluster 1689213737.8361306 mgr.a (mgr.14152) 1064 : cluster 0 pgmap v942: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:19.755 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:19 smithi154 bash[27744]: cluster 1689213737.8361306 mgr.a (mgr.14152) 1064 : cluster 0 pgmap v942: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:19.801 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:19 smithi137 bash[27262]: cluster 1689213737.8361306 mgr.a (mgr.14152) 1064 : cluster 0 pgmap v942: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.610 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:20.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213739.5630748 mon.a (mon.0) 1168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213739.5699155 mon.a (mon.0) 1169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: cluster 1689213739.8366132 mgr.a (mgr.14152) 1065 : cluster 0 pgmap v943: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.807 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213740.0402696 mon.a (mon.0) 1170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213740.041937 mon.a (mon.0) 1171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213740.0436075 mon.a (mon.0) 1172 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: cephadm 1689213740.0448532 mgr.a (mgr.14152) 1066 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T02:02:20.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213740.0470593 mon.a (mon.0) 1173 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:02:20.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213740.0483735 mon.a (mon.0) 1174 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:02:20.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: cluster 1689213740.0508566 mgr.a (mgr.14152) 1067 : cluster 0 pgmap v944: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: cluster 1689213740.0512125 mgr.a (mgr.14152) 1068 : cluster 0 pgmap v945: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:20 smithi022 bash[26979]: audit 1689213740.0575998 mon.a (mon.0) 1175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213739.5630748 mon.a (mon.0) 1168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.853 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213739.5699155 mon.a (mon.0) 1169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: cluster 1689213739.8366132 mgr.a (mgr.14152) 1065 : cluster 0 pgmap v943: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213740.0402696 mon.a (mon.0) 1170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.854 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213740.041937 mon.a (mon.0) 1171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213740.0436075 mon.a (mon.0) 1172 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: cephadm 1689213740.0448532 mgr.a (mgr.14152) 1066 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T02:02:20.855 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213740.0470593 mon.a (mon.0) 1173 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:02:20.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213740.0483735 mon.a (mon.0) 1174 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:02:20.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: cluster 1689213740.0508566 mgr.a (mgr.14152) 1067 : cluster 0 pgmap v944: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.856 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: cluster 1689213740.0512125 mgr.a (mgr.14152) 1068 : cluster 0 pgmap v945: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:20 smithi103 bash[27315]: audit 1689213740.0575998 mon.a (mon.0) 1175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.891 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213739.5630748 mon.a (mon.0) 1168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.891 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213739.5699155 mon.a (mon.0) 1169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:20.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: cluster 1689213739.8366132 mgr.a (mgr.14152) 1065 : cluster 0 pgmap v943: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.892 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213740.0402696 mon.a (mon.0) 1170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213740.041937 mon.a (mon.0) 1171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213740.0436075 mon.a (mon.0) 1172 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:20.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: cephadm 1689213740.0448532 mgr.a (mgr.14152) 1066 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T02:02:20.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213740.0470593 mon.a (mon.0) 1173 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:02:20.893 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213740.0483735 mon.a (mon.0) 1174 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:02:20.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: cluster 1689213740.0508566 mgr.a (mgr.14152) 1067 : cluster 0 pgmap v944: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: cluster 1689213740.0512125 mgr.a (mgr.14152) 1068 : cluster 0 pgmap v945: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:20.894 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:20 smithi084 bash[27323]: audit 1689213740.0575998 mon.a (mon.0) 1175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213739.5630748 mon.a (mon.0) 1168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213739.5699155 mon.a (mon.0) 1169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: cluster 1689213739.8366132 mgr.a (mgr.14152) 1065 : cluster 0 pgmap v943: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213740.0402696 mon.a (mon.0) 1170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213740.041937 mon.a (mon.0) 1171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213740.0436075 mon.a (mon.0) 1172 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: cephadm 1689213740.0448532 mgr.a (mgr.14152) 1066 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T02:02:21.006 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213740.0470593 mon.a (mon.0) 1173 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:02:21.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213740.0483735 mon.a (mon.0) 1174 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:02:21.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: cluster 1689213740.0508566 mgr.a (mgr.14152) 1067 : cluster 0 pgmap v944: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:21.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: cluster 1689213740.0512125 mgr.a (mgr.14152) 1068 : cluster 0 pgmap v945: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:21.007 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:20 smithi154 bash[27744]: audit 1689213740.0575998 mon.a (mon.0) 1175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213739.5630748 mon.a (mon.0) 1168 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213739.5699155 mon.a (mon.0) 1169 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: cluster 1689213739.8366132 mgr.a (mgr.14152) 1065 : cluster 0 pgmap v943: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:21.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213740.0402696 mon.a (mon.0) 1170 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.12", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:21.052 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213740.041937 mon.a (mon.0) 1171 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.13", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213740.0436075 mon.a (mon.0) 1172 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.14", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: cephadm 1689213740.0448532 mgr.a (mgr.14152) 1066 : cephadm 1 Adjusting osd_memory_target on smithi154 to 5755M 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213740.0470593 mon.a (mon.0) 1173 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213740.0483735 mon.a (mon.0) 1174 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: cluster 1689213740.0508566 mgr.a (mgr.14152) 1067 : cluster 0 pgmap v944: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: cluster 1689213740.0512125 mgr.a (mgr.14152) 1068 : cluster 0 pgmap v945: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:21.053 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:20 smithi137 bash[27262]: audit 1689213740.0575998 mon.a (mon.0) 1175 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:02:21.315 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:02:21.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:21 smithi022 bash[26979]: cluster 1689213740.566685 mon.a (mon.0) 1176 : cluster 3 Health check update: 15 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T02:02:21.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:21 smithi022 bash[26979]: audit 1689213740.6212234 mon.d (mon.3) 15 : audit 0 from='client.? 172.21.15.22:0/4065912661' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:21.851 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:21 smithi103 bash[27315]: cluster 1689213740.566685 mon.a (mon.0) 1176 : cluster 3 Health check update: 15 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T02:02:21.852 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:21 smithi103 bash[27315]: audit 1689213740.6212234 mon.d (mon.3) 15 : audit 0 from='client.? 172.21.15.22:0/4065912661' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:21.891 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:21 smithi084 bash[27323]: cluster 1689213740.566685 mon.a (mon.0) 1176 : cluster 3 Health check update: 15 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T02:02:21.891 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:21 smithi084 bash[27323]: audit 1689213740.6212234 mon.d (mon.3) 15 : audit 0 from='client.? 172.21.15.22:0/4065912661' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:22.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:21 smithi154 bash[27744]: cluster 1689213740.566685 mon.a (mon.0) 1176 : cluster 3 Health check update: 15 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T02:02:22.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:21 smithi154 bash[27744]: audit 1689213740.6212234 mon.d (mon.3) 15 : audit 0 from='client.? 172.21.15.22:0/4065912661' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:22.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:21 smithi137 bash[27262]: cluster 1689213740.566685 mon.a (mon.0) 1176 : cluster 3 Health check update: 15 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-07-13T02:02:22.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:21 smithi137 bash[27262]: audit 1689213740.6212234 mon.d (mon.3) 15 : audit 0 from='client.? 172.21.15.22:0/4065912661' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:22.315 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:02:22.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:22 smithi022 bash[26979]: cluster 1689213742.0516825 mgr.a (mgr.14152) 1069 : cluster 0 pgmap v946: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:22.851 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:22 smithi103 bash[27315]: cluster 1689213742.0516825 mgr.a (mgr.14152) 1069 : cluster 0 pgmap v946: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:22.891 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:22 smithi084 bash[27323]: cluster 1689213742.0516825 mgr.a (mgr.14152) 1069 : cluster 0 pgmap v946: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:23.005 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:22 smithi154 bash[27744]: cluster 1689213742.0516825 mgr.a (mgr.14152) 1069 : cluster 0 pgmap v946: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:23.051 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:22 smithi137 bash[27262]: cluster 1689213742.0516825 mgr.a (mgr.14152) 1069 : cluster 0 pgmap v946: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:25.351 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:25 smithi103 bash[27315]: cluster 1689213744.052224 mgr.a (mgr.14152) 1070 : cluster 0 pgmap v947: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:25.391 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:25 smithi084 bash[27323]: cluster 1689213744.052224 mgr.a (mgr.14152) 1070 : cluster 0 pgmap v947: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:25.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:25 smithi022 bash[26979]: cluster 1689213744.052224 mgr.a (mgr.14152) 1070 : cluster 0 pgmap v947: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:25.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:25 smithi154 bash[27744]: cluster 1689213744.052224 mgr.a (mgr.14152) 1070 : cluster 0 pgmap v947: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:25.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:25 smithi137 bash[27262]: cluster 1689213744.052224 mgr.a (mgr.14152) 1070 : cluster 0 pgmap v947: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:27.009 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:02:27.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:27 smithi022 bash[26979]: cluster 1689213746.0527444 mgr.a (mgr.14152) 1071 : cluster 0 pgmap v948: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:27.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:27 smithi154 bash[27744]: cluster 1689213746.0527444 mgr.a (mgr.14152) 1071 : cluster 0 pgmap v948: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:27.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:27 smithi137 bash[27262]: cluster 1689213746.0527444 mgr.a (mgr.14152) 1071 : cluster 0 pgmap v948: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:27.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:27 smithi103 bash[27315]: cluster 1689213746.0527444 mgr.a (mgr.14152) 1071 : cluster 0 pgmap v948: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:27.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:27 smithi084 bash[27323]: cluster 1689213746.0527444 mgr.a (mgr.14152) 1071 : cluster 0 pgmap v948: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:29.407 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:29 smithi022 bash[26979]: cluster 1689213748.0532413 mgr.a (mgr.14152) 1072 : cluster 0 pgmap v949: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:29.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:29 smithi154 bash[27744]: cluster 1689213748.0532413 mgr.a (mgr.14152) 1072 : cluster 0 pgmap v949: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:29.551 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:29 smithi137 bash[27262]: cluster 1689213748.0532413 mgr.a (mgr.14152) 1072 : cluster 0 pgmap v949: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:29.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:29 smithi103 bash[27315]: cluster 1689213748.0532413 mgr.a (mgr.14152) 1072 : cluster 0 pgmap v949: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:29.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:29 smithi084 bash[27323]: cluster 1689213748.0532413 mgr.a (mgr.14152) 1072 : cluster 0 pgmap v949: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:30.358 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:31.093 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:02:31.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:31 smithi022 bash[26979]: cluster 1689213750.053872 mgr.a (mgr.14152) 1073 : cluster 0 pgmap v950: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:31.408 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:31 smithi022 bash[26979]: audit 1689213750.3686783 mon.d (mon.3) 16 : audit 0 from='client.? 172.21.15.22:0/1181713546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:31.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:31 smithi154 bash[27744]: cluster 1689213750.053872 mgr.a (mgr.14152) 1073 : cluster 0 pgmap v950: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:31.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:31 smithi154 bash[27744]: audit 1689213750.3686783 mon.d (mon.3) 16 : audit 0 from='client.? 172.21.15.22:0/1181713546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:31.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:31 smithi137 bash[27262]: cluster 1689213750.053872 mgr.a (mgr.14152) 1073 : cluster 0 pgmap v950: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:31.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:31 smithi137 bash[27262]: audit 1689213750.3686783 mon.d (mon.3) 16 : audit 0 from='client.? 172.21.15.22:0/1181713546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:31.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:31 smithi103 bash[27315]: cluster 1689213750.053872 mgr.a (mgr.14152) 1073 : cluster 0 pgmap v950: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:31.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:31 smithi103 bash[27315]: audit 1689213750.3686783 mon.d (mon.3) 16 : audit 0 from='client.? 172.21.15.22:0/1181713546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:31.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:31 smithi084 bash[27323]: cluster 1689213750.053872 mgr.a (mgr.14152) 1073 : cluster 0 pgmap v950: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:31.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:31 smithi084 bash[27323]: audit 1689213750.3686783 mon.d (mon.3) 16 : audit 0 from='client.? 172.21.15.22:0/1181713546' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:32.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:02:33.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:33 smithi154 bash[27744]: cluster 1689213752.0544848 mgr.a (mgr.14152) 1074 : cluster 0 pgmap v951: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:33.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:33 smithi137 bash[27262]: cluster 1689213752.0544848 mgr.a (mgr.14152) 1074 : cluster 0 pgmap v951: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:33.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:33 smithi103 bash[27315]: cluster 1689213752.0544848 mgr.a (mgr.14152) 1074 : cluster 0 pgmap v951: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:33.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:33 smithi084 bash[27323]: cluster 1689213752.0544848 mgr.a (mgr.14152) 1074 : cluster 0 pgmap v951: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:33.657 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:33 smithi022 bash[26979]: cluster 1689213752.0544848 mgr.a (mgr.14152) 1074 : cluster 0 pgmap v951: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:35.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:35 smithi154 bash[27744]: cluster 1689213754.0551207 mgr.a (mgr.14152) 1075 : cluster 0 pgmap v952: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:35.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:35 smithi137 bash[27262]: cluster 1689213754.0551207 mgr.a (mgr.14152) 1075 : cluster 0 pgmap v952: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:35.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:35 smithi103 bash[27315]: cluster 1689213754.0551207 mgr.a (mgr.14152) 1075 : cluster 0 pgmap v952: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:35.641 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:35 smithi084 bash[27323]: cluster 1689213754.0551207 mgr.a (mgr.14152) 1075 : cluster 0 pgmap v952: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:35.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:35 smithi022 bash[26979]: cluster 1689213754.0551207 mgr.a (mgr.14152) 1075 : cluster 0 pgmap v952: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:36.785 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:02:37.505 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:37 smithi154 bash[27744]: cluster 1689213756.0556092 mgr.a (mgr.14152) 1076 : cluster 0 pgmap v953: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:37.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:37 smithi137 bash[27262]: cluster 1689213756.0556092 mgr.a (mgr.14152) 1076 : cluster 0 pgmap v953: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:37.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:37 smithi103 bash[27315]: cluster 1689213756.0556092 mgr.a (mgr.14152) 1076 : cluster 0 pgmap v953: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:37.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:37 smithi084 bash[27323]: cluster 1689213756.0556092 mgr.a (mgr.14152) 1076 : cluster 0 pgmap v953: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:37.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:37 smithi022 bash[26979]: cluster 1689213756.0556092 mgr.a (mgr.14152) 1076 : cluster 0 pgmap v953: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:39.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:39 smithi154 bash[27744]: cluster 1689213758.0561297 mgr.a (mgr.14152) 1077 : cluster 0 pgmap v954: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:39.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:39 smithi137 bash[27262]: cluster 1689213758.0561297 mgr.a (mgr.14152) 1077 : cluster 0 pgmap v954: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:39.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:39 smithi103 bash[27315]: cluster 1689213758.0561297 mgr.a (mgr.14152) 1077 : cluster 0 pgmap v954: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:39.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:39 smithi084 bash[27323]: cluster 1689213758.0561297 mgr.a (mgr.14152) 1077 : cluster 0 pgmap v954: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:39.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:39 smithi022 bash[26979]: cluster 1689213758.0561297 mgr.a (mgr.14152) 1077 : cluster 0 pgmap v954: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:40.129 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:40.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:40 smithi154 bash[27744]: audit 1689213760.1395884 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.22:0/3710038684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:40.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:40 smithi137 bash[27262]: audit 1689213760.1395884 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.22:0/3710038684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:40.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:40 smithi103 bash[27315]: audit 1689213760.1395884 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.22:0/3710038684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:40.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:40 smithi084 bash[27323]: audit 1689213760.1395884 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.22:0/3710038684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:40.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:40 smithi022 bash[26979]: audit 1689213760.1395884 mon.c (mon.2) 20 : audit 0 from='client.? 172.21.15.22:0/3710038684' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:40.870 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:02:41.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:41 smithi154 bash[27744]: cluster 1689213760.0564783 mgr.a (mgr.14152) 1078 : cluster 0 pgmap v955: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:41.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:41 smithi137 bash[27262]: cluster 1689213760.0564783 mgr.a (mgr.14152) 1078 : cluster 0 pgmap v955: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:41.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:41 smithi103 bash[27315]: cluster 1689213760.0564783 mgr.a (mgr.14152) 1078 : cluster 0 pgmap v955: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:41.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:41 smithi084 bash[27323]: cluster 1689213760.0564783 mgr.a (mgr.14152) 1078 : cluster 0 pgmap v955: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:41.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:41 smithi022 bash[26979]: cluster 1689213760.0564783 mgr.a (mgr.14152) 1078 : cluster 0 pgmap v955: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:41.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:02:43.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:43 smithi154 bash[27744]: cluster 1689213762.0570018 mgr.a (mgr.14152) 1079 : cluster 0 pgmap v956: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:43.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:43 smithi137 bash[27262]: cluster 1689213762.0570018 mgr.a (mgr.14152) 1079 : cluster 0 pgmap v956: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:43.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:43 smithi103 bash[27315]: cluster 1689213762.0570018 mgr.a (mgr.14152) 1079 : cluster 0 pgmap v956: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:43.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:43 smithi084 bash[27323]: cluster 1689213762.0570018 mgr.a (mgr.14152) 1079 : cluster 0 pgmap v956: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:43.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:43 smithi022 bash[26979]: cluster 1689213762.0570018 mgr.a (mgr.14152) 1079 : cluster 0 pgmap v956: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:45.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:45 smithi154 bash[27744]: cluster 1689213764.0573869 mgr.a (mgr.14152) 1080 : cluster 0 pgmap v957: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:45.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:45 smithi137 bash[27262]: cluster 1689213764.0573869 mgr.a (mgr.14152) 1080 : cluster 0 pgmap v957: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:45.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:45 smithi103 bash[27315]: cluster 1689213764.0573869 mgr.a (mgr.14152) 1080 : cluster 0 pgmap v957: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:45.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:45 smithi084 bash[27323]: cluster 1689213764.0573869 mgr.a (mgr.14152) 1080 : cluster 0 pgmap v957: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:45.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:45 smithi022 bash[26979]: cluster 1689213764.0573869 mgr.a (mgr.14152) 1080 : cluster 0 pgmap v957: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:46.566 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:02:47.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:47 smithi154 bash[27744]: cluster 1689213766.0578704 mgr.a (mgr.14152) 1081 : cluster 0 pgmap v958: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:47.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:47 smithi022 bash[26979]: cluster 1689213766.0578704 mgr.a (mgr.14152) 1081 : cluster 0 pgmap v958: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:47.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:47 smithi137 bash[27262]: cluster 1689213766.0578704 mgr.a (mgr.14152) 1081 : cluster 0 pgmap v958: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:47.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:47 smithi103 bash[27315]: cluster 1689213766.0578704 mgr.a (mgr.14152) 1081 : cluster 0 pgmap v958: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:47.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:47 smithi084 bash[27323]: cluster 1689213766.0578704 mgr.a (mgr.14152) 1081 : cluster 0 pgmap v958: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:49.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:49 smithi154 bash[27744]: cluster 1689213768.058489 mgr.a (mgr.14152) 1082 : cluster 0 pgmap v959: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:49.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:49 smithi137 bash[27262]: cluster 1689213768.058489 mgr.a (mgr.14152) 1082 : cluster 0 pgmap v959: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:49.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:49 smithi103 bash[27315]: cluster 1689213768.058489 mgr.a (mgr.14152) 1082 : cluster 0 pgmap v959: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:49.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:49 smithi084 bash[27323]: cluster 1689213768.058489 mgr.a (mgr.14152) 1082 : cluster 0 pgmap v959: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:49.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:49 smithi022 bash[26979]: cluster 1689213768.058489 mgr.a (mgr.14152) 1082 : cluster 0 pgmap v959: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:49.752 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:50.471 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:02:50.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:50 smithi154 bash[27744]: audit 1689213769.7590072 mon.a (mon.0) 1177 : audit 0 from='client.? 172.21.15.22:0/2636328497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:50.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:50 smithi137 bash[27262]: audit 1689213769.7590072 mon.a (mon.0) 1177 : audit 0 from='client.? 172.21.15.22:0/2636328497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:50.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:50 smithi103 bash[27315]: audit 1689213769.7590072 mon.a (mon.0) 1177 : audit 0 from='client.? 172.21.15.22:0/2636328497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:50.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:50 smithi084 bash[27323]: audit 1689213769.7590072 mon.a (mon.0) 1177 : audit 0 from='client.? 172.21.15.22:0/2636328497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:50.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:50 smithi022 bash[26979]: audit 1689213769.7590072 mon.a (mon.0) 1177 : audit 0 from='client.? 172.21.15.22:0/2636328497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:02:51.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:02:51.487 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:51 smithi022 bash[26979]: cluster 1689213770.0588975 mgr.a (mgr.14152) 1083 : cluster 0 pgmap v960: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:51.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:51 smithi154 bash[27744]: cluster 1689213770.0588975 mgr.a (mgr.14152) 1083 : cluster 0 pgmap v960: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:51.552 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:51 smithi137 bash[27262]: cluster 1689213770.0588975 mgr.a (mgr.14152) 1083 : cluster 0 pgmap v960: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:51.602 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:51 smithi103 bash[27315]: cluster 1689213770.0588975 mgr.a (mgr.14152) 1083 : cluster 0 pgmap v960: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:51.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:51 smithi084 bash[27323]: cluster 1689213770.0588975 mgr.a (mgr.14152) 1083 : cluster 0 pgmap v960: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:53.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:53 smithi154 bash[27744]: cluster 1689213772.0593784 mgr.a (mgr.14152) 1084 : cluster 0 pgmap v961: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:53.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:53 smithi137 bash[27262]: cluster 1689213772.0593784 mgr.a (mgr.14152) 1084 : cluster 0 pgmap v961: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:53.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:53 smithi103 bash[27315]: cluster 1689213772.0593784 mgr.a (mgr.14152) 1084 : cluster 0 pgmap v961: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:53.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:53 smithi084 bash[27323]: cluster 1689213772.0593784 mgr.a (mgr.14152) 1084 : cluster 0 pgmap v961: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:53.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:53 smithi022 bash[26979]: cluster 1689213772.0593784 mgr.a (mgr.14152) 1084 : cluster 0 pgmap v961: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:55.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:55 smithi154 bash[27744]: cluster 1689213774.0598614 mgr.a (mgr.14152) 1085 : cluster 0 pgmap v962: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:55.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:55 smithi137 bash[27262]: cluster 1689213774.0598614 mgr.a (mgr.14152) 1085 : cluster 0 pgmap v962: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:55.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:55 smithi103 bash[27315]: cluster 1689213774.0598614 mgr.a (mgr.14152) 1085 : cluster 0 pgmap v962: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:55.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:55 smithi084 bash[27323]: cluster 1689213774.0598614 mgr.a (mgr.14152) 1085 : cluster 0 pgmap v962: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:55.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:55 smithi022 bash[26979]: cluster 1689213774.0598614 mgr.a (mgr.14152) 1085 : cluster 0 pgmap v962: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:02:57.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:57 smithi022 bash[26979]: cluster 1689213776.0604358 mgr.a (mgr.14152) 1086 : cluster 0 pgmap v963: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:57.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:57 smithi154 bash[27744]: cluster 1689213776.0604358 mgr.a (mgr.14152) 1086 : cluster 0 pgmap v963: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:57.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:57 smithi137 bash[27262]: cluster 1689213776.0604358 mgr.a (mgr.14152) 1086 : cluster 0 pgmap v963: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:57.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:57 smithi103 bash[27315]: cluster 1689213776.0604358 mgr.a (mgr.14152) 1086 : cluster 0 pgmap v963: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:57.642 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:57 smithi084 bash[27323]: cluster 1689213776.0604358 mgr.a (mgr.14152) 1086 : cluster 0 pgmap v963: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:59.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:02:59 smithi022 bash[26979]: cluster 1689213778.0609603 mgr.a (mgr.14152) 1087 : cluster 0 pgmap v964: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:59.499 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:02:59.506 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:02:59 smithi154 bash[27744]: cluster 1689213778.0609603 mgr.a (mgr.14152) 1087 : cluster 0 pgmap v964: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:59.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:02:59 smithi137 bash[27262]: cluster 1689213778.0609603 mgr.a (mgr.14152) 1087 : cluster 0 pgmap v964: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:59.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:02:59 smithi103 bash[27315]: cluster 1689213778.0609603 mgr.a (mgr.14152) 1087 : cluster 0 pgmap v964: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:02:59.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:02:59 smithi084 bash[27323]: cluster 1689213778.0609603 mgr.a (mgr.14152) 1087 : cluster 0 pgmap v964: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:00.263 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:00.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:00 smithi137 bash[27262]: audit 1689213779.509047 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.22:0/4288189610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:00.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:00 smithi103 bash[27315]: audit 1689213779.509047 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.22:0/4288189610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:00.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:00 smithi084 bash[27323]: audit 1689213779.509047 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.22:0/4288189610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:00.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:00 smithi022 bash[26979]: audit 1689213779.509047 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.22:0/4288189610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:00.756 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:00 smithi154 bash[27744]: audit 1689213779.509047 mon.c (mon.2) 21 : audit 0 from='client.? 172.21.15.22:0/4288189610' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:01.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:01.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:01 smithi137 bash[27262]: cluster 1689213780.0614457 mgr.a (mgr.14152) 1088 : cluster 0 pgmap v965: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:01.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:01 smithi103 bash[27315]: cluster 1689213780.0614457 mgr.a (mgr.14152) 1088 : cluster 0 pgmap v965: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:01.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:01 smithi084 bash[27323]: cluster 1689213780.0614457 mgr.a (mgr.14152) 1088 : cluster 0 pgmap v965: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:01.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:01 smithi022 bash[26979]: cluster 1689213780.0614457 mgr.a (mgr.14152) 1088 : cluster 0 pgmap v965: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:01.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:01 smithi154 bash[27744]: cluster 1689213780.0614457 mgr.a (mgr.14152) 1088 : cluster 0 pgmap v965: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:03.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:03 smithi137 bash[27262]: cluster 1689213782.0619721 mgr.a (mgr.14152) 1089 : cluster 0 pgmap v966: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:03.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:03 smithi103 bash[27315]: cluster 1689213782.0619721 mgr.a (mgr.14152) 1089 : cluster 0 pgmap v966: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:03.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:03 smithi084 bash[27323]: cluster 1689213782.0619721 mgr.a (mgr.14152) 1089 : cluster 0 pgmap v966: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:03.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:03 smithi022 bash[26979]: cluster 1689213782.0619721 mgr.a (mgr.14152) 1089 : cluster 0 pgmap v966: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:03.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:03 smithi154 bash[27744]: cluster 1689213782.0619721 mgr.a (mgr.14152) 1089 : cluster 0 pgmap v966: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:05.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:05 smithi137 bash[27262]: cluster 1689213784.0624912 mgr.a (mgr.14152) 1090 : cluster 0 pgmap v967: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:05.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:05 smithi103 bash[27315]: cluster 1689213784.0624912 mgr.a (mgr.14152) 1090 : cluster 0 pgmap v967: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:05.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:05 smithi084 bash[27323]: cluster 1689213784.0624912 mgr.a (mgr.14152) 1090 : cluster 0 pgmap v967: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:05.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:05 smithi022 bash[26979]: cluster 1689213784.0624912 mgr.a (mgr.14152) 1090 : cluster 0 pgmap v967: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:05.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:05 smithi154 bash[27744]: cluster 1689213784.0624912 mgr.a (mgr.14152) 1090 : cluster 0 pgmap v967: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:05.962 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:03:07.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:07 smithi137 bash[27262]: cluster 1689213786.0630279 mgr.a (mgr.14152) 1091 : cluster 0 pgmap v968: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:07.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:07 smithi103 bash[27315]: cluster 1689213786.0630279 mgr.a (mgr.14152) 1091 : cluster 0 pgmap v968: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:07.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:07 smithi084 bash[27323]: cluster 1689213786.0630279 mgr.a (mgr.14152) 1091 : cluster 0 pgmap v968: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:07.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:07 smithi022 bash[26979]: cluster 1689213786.0630279 mgr.a (mgr.14152) 1091 : cluster 0 pgmap v968: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:07.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:07 smithi154 bash[27744]: cluster 1689213786.0630279 mgr.a (mgr.14152) 1091 : cluster 0 pgmap v968: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:09.306 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:03:09.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:09 smithi137 bash[27262]: cluster 1689213788.0635488 mgr.a (mgr.14152) 1092 : cluster 0 pgmap v969: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:09.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:09 smithi103 bash[27315]: cluster 1689213788.0635488 mgr.a (mgr.14152) 1092 : cluster 0 pgmap v969: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:09.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:09 smithi084 bash[27323]: cluster 1689213788.0635488 mgr.a (mgr.14152) 1092 : cluster 0 pgmap v969: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:09.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:09 smithi022 bash[26979]: cluster 1689213788.0635488 mgr.a (mgr.14152) 1092 : cluster 0 pgmap v969: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:09.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:09 smithi154 bash[27744]: cluster 1689213788.0635488 mgr.a (mgr.14152) 1092 : cluster 0 pgmap v969: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:10.035 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:10.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:10 smithi137 bash[27262]: audit 1689213789.312158 mon.a (mon.0) 1178 : audit 0 from='client.? 172.21.15.22:0/3275257182' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:10.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:10 smithi103 bash[27315]: audit 1689213789.312158 mon.a (mon.0) 1178 : audit 0 from='client.? 172.21.15.22:0/3275257182' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:10.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:10 smithi084 bash[27323]: audit 1689213789.312158 mon.a (mon.0) 1178 : audit 0 from='client.? 172.21.15.22:0/3275257182' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:10.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:10 smithi022 bash[26979]: audit 1689213789.312158 mon.a (mon.0) 1178 : audit 0 from='client.? 172.21.15.22:0/3275257182' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:10.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:10 smithi154 bash[27744]: audit 1689213789.312158 mon.a (mon.0) 1178 : audit 0 from='client.? 172.21.15.22:0/3275257182' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:11.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:11.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:11 smithi022 bash[26979]: cluster 1689213790.064101 mgr.a (mgr.14152) 1093 : cluster 0 pgmap v970: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:11.553 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:11 smithi137 bash[27262]: cluster 1689213790.064101 mgr.a (mgr.14152) 1093 : cluster 0 pgmap v970: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:11.603 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:11 smithi103 bash[27315]: cluster 1689213790.064101 mgr.a (mgr.14152) 1093 : cluster 0 pgmap v970: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:11.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:11 smithi084 bash[27323]: cluster 1689213790.064101 mgr.a (mgr.14152) 1093 : cluster 0 pgmap v970: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:11.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:11 smithi154 bash[27744]: cluster 1689213790.064101 mgr.a (mgr.14152) 1093 : cluster 0 pgmap v970: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:13.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:13 smithi137 bash[27262]: cluster 1689213792.0646195 mgr.a (mgr.14152) 1094 : cluster 0 pgmap v971: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:13.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:13 smithi103 bash[27315]: cluster 1689213792.0646195 mgr.a (mgr.14152) 1094 : cluster 0 pgmap v971: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:13.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:13 smithi084 bash[27323]: cluster 1689213792.0646195 mgr.a (mgr.14152) 1094 : cluster 0 pgmap v971: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:13.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:13 smithi022 bash[26979]: cluster 1689213792.0646195 mgr.a (mgr.14152) 1094 : cluster 0 pgmap v971: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:13.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:13 smithi154 bash[27744]: cluster 1689213792.0646195 mgr.a (mgr.14152) 1094 : cluster 0 pgmap v971: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:15.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:15 smithi137 bash[27262]: cluster 1689213794.0651476 mgr.a (mgr.14152) 1095 : cluster 0 pgmap v972: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:15.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:15 smithi103 bash[27315]: cluster 1689213794.0651476 mgr.a (mgr.14152) 1095 : cluster 0 pgmap v972: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:15.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:15 smithi084 bash[27323]: cluster 1689213794.0651476 mgr.a (mgr.14152) 1095 : cluster 0 pgmap v972: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:15.659 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:15 smithi022 bash[26979]: cluster 1689213794.0651476 mgr.a (mgr.14152) 1095 : cluster 0 pgmap v972: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:15.732 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:03:15.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:15 smithi154 bash[27744]: cluster 1689213794.0651476 mgr.a (mgr.14152) 1095 : cluster 0 pgmap v972: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:17.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:17 smithi022 bash[26979]: cluster 1689213796.0655243 mgr.a (mgr.14152) 1096 : cluster 0 pgmap v973: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:17.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:17 smithi137 bash[27262]: cluster 1689213796.0655243 mgr.a (mgr.14152) 1096 : cluster 0 pgmap v973: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:17.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:17 smithi103 bash[27315]: cluster 1689213796.0655243 mgr.a (mgr.14152) 1096 : cluster 0 pgmap v973: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:17.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:17 smithi084 bash[27323]: cluster 1689213796.0655243 mgr.a (mgr.14152) 1096 : cluster 0 pgmap v973: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:17.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:17 smithi154 bash[27744]: cluster 1689213796.0655243 mgr.a (mgr.14152) 1096 : cluster 0 pgmap v973: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:19.162 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:03:19.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:19 smithi103 bash[27315]: cluster 1689213798.0660043 mgr.a (mgr.14152) 1097 : cluster 0 pgmap v974: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:19.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:19 smithi103 bash[27315]: audit 1689213799.1705253 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.22:0/2781018723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:19.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:19 smithi084 bash[27323]: cluster 1689213798.0660043 mgr.a (mgr.14152) 1097 : cluster 0 pgmap v974: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:19.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:19 smithi084 bash[27323]: audit 1689213799.1705253 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.22:0/2781018723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:19.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:19 smithi022 bash[26979]: cluster 1689213798.0660043 mgr.a (mgr.14152) 1097 : cluster 0 pgmap v974: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:19.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:19 smithi022 bash[26979]: audit 1689213799.1705253 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.22:0/2781018723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:19.757 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:19 smithi154 bash[27744]: cluster 1689213798.0660043 mgr.a (mgr.14152) 1097 : cluster 0 pgmap v974: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:19.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:19 smithi154 bash[27744]: audit 1689213799.1705253 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.22:0/2781018723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:19.804 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:19 smithi137 bash[27262]: cluster 1689213798.0660043 mgr.a (mgr.14152) 1097 : cluster 0 pgmap v974: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:19.804 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:19 smithi137 bash[27262]: audit 1689213799.1705253 mon.c (mon.2) 22 : audit 0 from='client.? 172.21.15.22:0/2781018723' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:19.897 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:20.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:21.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:21 smithi154 bash[27744]: cluster 1689213800.066563 mgr.a (mgr.14152) 1098 : cluster 0 pgmap v975: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:21.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:21 smithi154 bash[27744]: audit 1689213800.2253375 mon.a (mon.0) 1179 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:03:21.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:21 smithi137 bash[27262]: cluster 1689213800.066563 mgr.a (mgr.14152) 1098 : cluster 0 pgmap v975: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:21.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:21 smithi137 bash[27262]: audit 1689213800.2253375 mon.a (mon.0) 1179 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:03:21.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:21 smithi103 bash[27315]: cluster 1689213800.066563 mgr.a (mgr.14152) 1098 : cluster 0 pgmap v975: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:21.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:21 smithi103 bash[27315]: audit 1689213800.2253375 mon.a (mon.0) 1179 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:03:21.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:21 smithi084 bash[27323]: cluster 1689213800.066563 mgr.a (mgr.14152) 1098 : cluster 0 pgmap v975: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:21.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:21 smithi084 bash[27323]: audit 1689213800.2253375 mon.a (mon.0) 1179 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:03:21.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:21 smithi022 bash[26979]: cluster 1689213800.066563 mgr.a (mgr.14152) 1098 : cluster 0 pgmap v975: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:21.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:21 smithi022 bash[26979]: audit 1689213800.2253375 mon.a (mon.0) 1179 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:03:23.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:23 smithi154 bash[27744]: cluster 1689213802.0671115 mgr.a (mgr.14152) 1099 : cluster 0 pgmap v976: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:23.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:23 smithi137 bash[27262]: cluster 1689213802.0671115 mgr.a (mgr.14152) 1099 : cluster 0 pgmap v976: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:23.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:23 smithi103 bash[27315]: cluster 1689213802.0671115 mgr.a (mgr.14152) 1099 : cluster 0 pgmap v976: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:23.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:23 smithi084 bash[27323]: cluster 1689213802.0671115 mgr.a (mgr.14152) 1099 : cluster 0 pgmap v976: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:23.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:23 smithi022 bash[26979]: cluster 1689213802.0671115 mgr.a (mgr.14152) 1099 : cluster 0 pgmap v976: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:25.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:25 smithi154 bash[27744]: cluster 1689213804.067618 mgr.a (mgr.14152) 1100 : cluster 0 pgmap v977: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:25.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:25 smithi137 bash[27262]: cluster 1689213804.067618 mgr.a (mgr.14152) 1100 : cluster 0 pgmap v977: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:25.583 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:03:25.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:25 smithi103 bash[27315]: cluster 1689213804.067618 mgr.a (mgr.14152) 1100 : cluster 0 pgmap v977: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:25.621 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:25 smithi022 bash[26979]: cluster 1689213804.067618 mgr.a (mgr.14152) 1100 : cluster 0 pgmap v977: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:25.643 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:25 smithi084 bash[27323]: cluster 1689213804.067618 mgr.a (mgr.14152) 1100 : cluster 0 pgmap v977: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:26.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213805.7384763 mon.a (mon.0) 1180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:26.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213805.7451608 mon.a (mon.0) 1181 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:26.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: cluster 1689213806.0681393 mgr.a (mgr.14152) 1101 : cluster 0 pgmap v978: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213806.2229764 mon.a (mon.0) 1182 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213806.2248979 mon.a (mon.0) 1183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213806.2266479 mon.a (mon.0) 1184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: cephadm 1689213806.2280674 mgr.a (mgr.14152) 1102 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213806.230459 mon.a (mon.0) 1185 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213806.2318277 mon.a (mon.0) 1186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:03:26.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: cluster 1689213806.2344313 mgr.a (mgr.14152) 1103 : cluster 0 pgmap v979: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:26.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: cluster 1689213806.2346148 mgr.a (mgr.14152) 1104 : cluster 0 pgmap v980: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:26.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:26 smithi022 bash[26979]: audit 1689213806.2420304 mon.a (mon.0) 1187 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213805.7384763 mon.a (mon.0) 1180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213805.7451608 mon.a (mon.0) 1181 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.008 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: cluster 1689213806.0681393 mgr.a (mgr.14152) 1101 : cluster 0 pgmap v978: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213806.2229764 mon.a (mon.0) 1182 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213806.2248979 mon.a (mon.0) 1183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213806.2266479 mon.a (mon.0) 1184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: cephadm 1689213806.2280674 mgr.a (mgr.14152) 1102 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213806.230459 mon.a (mon.0) 1185 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213806.2318277 mon.a (mon.0) 1186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:03:27.009 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: cluster 1689213806.2344313 mgr.a (mgr.14152) 1103 : cluster 0 pgmap v979: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: cluster 1689213806.2346148 mgr.a (mgr.14152) 1104 : cluster 0 pgmap v980: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.010 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:26 smithi154 bash[27744]: audit 1689213806.2420304 mon.a (mon.0) 1187 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.054 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213805.7384763 mon.a (mon.0) 1180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213805.7451608 mon.a (mon.0) 1181 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: cluster 1689213806.0681393 mgr.a (mgr.14152) 1101 : cluster 0 pgmap v978: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213806.2229764 mon.a (mon.0) 1182 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213806.2248979 mon.a (mon.0) 1183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.055 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213806.2266479 mon.a (mon.0) 1184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: cephadm 1689213806.2280674 mgr.a (mgr.14152) 1102 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T02:03:27.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213806.230459 mon.a (mon.0) 1185 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:03:27.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213806.2318277 mon.a (mon.0) 1186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:03:27.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: cluster 1689213806.2344313 mgr.a (mgr.14152) 1103 : cluster 0 pgmap v979: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: cluster 1689213806.2346148 mgr.a (mgr.14152) 1104 : cluster 0 pgmap v980: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.056 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:26 smithi137 bash[27262]: audit 1689213806.2420304 mon.a (mon.0) 1187 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.104 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213805.7384763 mon.a (mon.0) 1180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213805.7451608 mon.a (mon.0) 1181 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: cluster 1689213806.0681393 mgr.a (mgr.14152) 1101 : cluster 0 pgmap v978: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213806.2229764 mon.a (mon.0) 1182 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213806.2248979 mon.a (mon.0) 1183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.105 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213806.2266479 mon.a (mon.0) 1184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: cephadm 1689213806.2280674 mgr.a (mgr.14152) 1102 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T02:03:27.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213806.230459 mon.a (mon.0) 1185 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:03:27.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213806.2318277 mon.a (mon.0) 1186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:03:27.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: cluster 1689213806.2344313 mgr.a (mgr.14152) 1103 : cluster 0 pgmap v979: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: cluster 1689213806.2346148 mgr.a (mgr.14152) 1104 : cluster 0 pgmap v980: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.106 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:26 smithi103 bash[27315]: audit 1689213806.2420304 mon.a (mon.0) 1187 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213805.7384763 mon.a (mon.0) 1180 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213805.7451608 mon.a (mon.0) 1181 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:27.144 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: cluster 1689213806.0681393 mgr.a (mgr.14152) 1101 : cluster 0 pgmap v978: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213806.2229764 mon.a (mon.0) 1182 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213806.2248979 mon.a (mon.0) 1183 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213806.2266479 mon.a (mon.0) 1184 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: cephadm 1689213806.2280674 mgr.a (mgr.14152) 1102 : cephadm 1 Adjusting osd_memory_target on smithi084 to 5755M 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213806.230459 mon.a (mon.0) 1185 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213806.2318277 mon.a (mon.0) 1186 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: cluster 1689213806.2344313 mgr.a (mgr.14152) 1103 : cluster 0 pgmap v979: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.145 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: cluster 1689213806.2346148 mgr.a (mgr.14152) 1104 : cluster 0 pgmap v980: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:27.146 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:26 smithi084 bash[27323]: audit 1689213806.2420304 mon.a (mon.0) 1187 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:03:28.845 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:03:29.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:29 smithi022 bash[26979]: cluster 1689213808.2350955 mgr.a (mgr.14152) 1105 : cluster 0 pgmap v981: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:29.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:29 smithi022 bash[26979]: audit 1689213808.85035 mon.a (mon.0) 1188 : audit 0 from='client.? 172.21.15.22:0/1648999703' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:29.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:29 smithi137 bash[27262]: cluster 1689213808.2350955 mgr.a (mgr.14152) 1105 : cluster 0 pgmap v981: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:29.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:29 smithi137 bash[27262]: audit 1689213808.85035 mon.a (mon.0) 1188 : audit 0 from='client.? 172.21.15.22:0/1648999703' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:29.580 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:29.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:29 smithi103 bash[27315]: cluster 1689213808.2350955 mgr.a (mgr.14152) 1105 : cluster 0 pgmap v981: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:29.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:29 smithi103 bash[27315]: audit 1689213808.85035 mon.a (mon.0) 1188 : audit 0 from='client.? 172.21.15.22:0/1648999703' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:29.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:29 smithi084 bash[27323]: cluster 1689213808.2350955 mgr.a (mgr.14152) 1105 : cluster 0 pgmap v981: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:29.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:29 smithi084 bash[27323]: audit 1689213808.85035 mon.a (mon.0) 1188 : audit 0 from='client.? 172.21.15.22:0/1648999703' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:29.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:29 smithi154 bash[27744]: cluster 1689213808.2350955 mgr.a (mgr.14152) 1105 : cluster 0 pgmap v981: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:29.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:29 smithi154 bash[27744]: audit 1689213808.85035 mon.a (mon.0) 1188 : audit 0 from='client.? 172.21.15.22:0/1648999703' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:30.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:31.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:31 smithi154 bash[27744]: cluster 1689213810.2356324 mgr.a (mgr.14152) 1106 : cluster 0 pgmap v982: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:31.554 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:31 smithi137 bash[27262]: cluster 1689213810.2356324 mgr.a (mgr.14152) 1106 : cluster 0 pgmap v982: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:31.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:31 smithi103 bash[27315]: cluster 1689213810.2356324 mgr.a (mgr.14152) 1106 : cluster 0 pgmap v982: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:31.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:31 smithi084 bash[27323]: cluster 1689213810.2356324 mgr.a (mgr.14152) 1106 : cluster 0 pgmap v982: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:31.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:31 smithi022 bash[26979]: cluster 1689213810.2356324 mgr.a (mgr.14152) 1106 : cluster 0 pgmap v982: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:33.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:33 smithi137 bash[27262]: cluster 1689213812.236165 mgr.a (mgr.14152) 1107 : cluster 0 pgmap v983: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:33.604 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:33 smithi103 bash[27315]: cluster 1689213812.236165 mgr.a (mgr.14152) 1107 : cluster 0 pgmap v983: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:33.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:33 smithi084 bash[27323]: cluster 1689213812.236165 mgr.a (mgr.14152) 1107 : cluster 0 pgmap v983: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:33.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:33 smithi022 bash[26979]: cluster 1689213812.236165 mgr.a (mgr.14152) 1107 : cluster 0 pgmap v983: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:33.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:33 smithi154 bash[27744]: cluster 1689213812.236165 mgr.a (mgr.14152) 1107 : cluster 0 pgmap v983: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:03:35.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:35 smithi137 bash[27262]: cluster 1689213814.2366788 mgr.a (mgr.14152) 1108 : cluster 0 pgmap v984: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:35.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:35 smithi103 bash[27315]: cluster 1689213814.2366788 mgr.a (mgr.14152) 1108 : cluster 0 pgmap v984: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:35.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:35 smithi084 bash[27323]: cluster 1689213814.2366788 mgr.a (mgr.14152) 1108 : cluster 0 pgmap v984: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:35.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:35 smithi022 bash[26979]: cluster 1689213814.2366788 mgr.a (mgr.14152) 1108 : cluster 0 pgmap v984: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:35.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:35 smithi154 bash[27744]: cluster 1689213814.2366788 mgr.a (mgr.14152) 1108 : cluster 0 pgmap v984: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:37.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:37 smithi137 bash[27262]: cluster 1689213816.2371423 mgr.a (mgr.14152) 1109 : cluster 0 pgmap v985: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:37.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:37 smithi103 bash[27315]: cluster 1689213816.2371423 mgr.a (mgr.14152) 1109 : cluster 0 pgmap v985: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:37.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:37 smithi084 bash[27323]: cluster 1689213816.2371423 mgr.a (mgr.14152) 1109 : cluster 0 pgmap v985: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:37.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:37 smithi022 bash[26979]: cluster 1689213816.2371423 mgr.a (mgr.14152) 1109 : cluster 0 pgmap v985: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:37.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:37 smithi154 bash[27744]: cluster 1689213816.2371423 mgr.a (mgr.14152) 1109 : cluster 0 pgmap v985: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:03:39.224 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:39.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:39 smithi103 bash[27315]: cluster 1689213818.2375333 mgr.a (mgr.14152) 1110 : cluster 0 pgmap v986: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:39.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:39 smithi103 bash[27315]: audit 1689213818.5209377 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.22:0/3712542836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:39.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:39 smithi084 bash[27323]: cluster 1689213818.2375333 mgr.a (mgr.14152) 1110 : cluster 0 pgmap v986: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:39.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:39 smithi084 bash[27323]: audit 1689213818.5209377 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.22:0/3712542836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:39.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:39 smithi022 bash[26979]: cluster 1689213818.2375333 mgr.a (mgr.14152) 1110 : cluster 0 pgmap v986: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:39.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:39 smithi022 bash[26979]: audit 1689213818.5209377 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.22:0/3712542836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:39.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:39 smithi154 bash[27744]: cluster 1689213818.2375333 mgr.a (mgr.14152) 1110 : cluster 0 pgmap v986: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:39.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:39 smithi154 bash[27744]: audit 1689213818.5209377 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.22:0/3712542836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:39.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:39 smithi137 bash[27262]: cluster 1689213818.2375333 mgr.a (mgr.14152) 1110 : cluster 0 pgmap v986: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:39.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:39 smithi137 bash[27262]: audit 1689213818.5209377 mon.a (mon.0) 1189 : audit 0 from='client.? 172.21.15.22:0/3712542836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:40.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:41.508 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:41 smithi154 bash[27744]: cluster 1689213820.2379963 mgr.a (mgr.14152) 1111 : cluster 0 pgmap v987: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:41.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:41 smithi137 bash[27262]: cluster 1689213820.2379963 mgr.a (mgr.14152) 1111 : cluster 0 pgmap v987: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:41.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:41 smithi103 bash[27315]: cluster 1689213820.2379963 mgr.a (mgr.14152) 1111 : cluster 0 pgmap v987: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:41.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:41 smithi084 bash[27323]: cluster 1689213820.2379963 mgr.a (mgr.14152) 1111 : cluster 0 pgmap v987: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:41.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:41 smithi022 bash[26979]: cluster 1689213820.2379963 mgr.a (mgr.14152) 1111 : cluster 0 pgmap v987: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:43.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:43 smithi137 bash[27262]: cluster 1689213822.2385168 mgr.a (mgr.14152) 1112 : cluster 0 pgmap v988: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:43.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:43 smithi103 bash[27315]: cluster 1689213822.2385168 mgr.a (mgr.14152) 1112 : cluster 0 pgmap v988: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:43.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:43 smithi084 bash[27323]: cluster 1689213822.2385168 mgr.a (mgr.14152) 1112 : cluster 0 pgmap v988: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:43.660 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:43 smithi022 bash[26979]: cluster 1689213822.2385168 mgr.a (mgr.14152) 1112 : cluster 0 pgmap v988: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:43.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:43 smithi154 bash[27744]: cluster 1689213822.2385168 mgr.a (mgr.14152) 1112 : cluster 0 pgmap v988: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:44.923 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:03:45.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:45 smithi137 bash[27262]: cluster 1689213824.2391388 mgr.a (mgr.14152) 1113 : cluster 0 pgmap v989: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:45.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:45 smithi103 bash[27315]: cluster 1689213824.2391388 mgr.a (mgr.14152) 1113 : cluster 0 pgmap v989: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:45.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:45 smithi084 bash[27323]: cluster 1689213824.2391388 mgr.a (mgr.14152) 1113 : cluster 0 pgmap v989: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:45.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:45 smithi022 bash[26979]: cluster 1689213824.2391388 mgr.a (mgr.14152) 1113 : cluster 0 pgmap v989: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:45.758 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:45 smithi154 bash[27744]: cluster 1689213824.2391388 mgr.a (mgr.14152) 1113 : cluster 0 pgmap v989: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:47.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:47 smithi137 bash[27262]: cluster 1689213826.2397206 mgr.a (mgr.14152) 1114 : cluster 0 pgmap v990: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:47.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:47 smithi103 bash[27315]: cluster 1689213826.2397206 mgr.a (mgr.14152) 1114 : cluster 0 pgmap v990: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:47.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:47 smithi084 bash[27323]: cluster 1689213826.2397206 mgr.a (mgr.14152) 1114 : cluster 0 pgmap v990: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:47.650 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:47 smithi022 bash[26979]: cluster 1689213826.2397206 mgr.a (mgr.14152) 1114 : cluster 0 pgmap v990: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:47.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:47 smithi154 bash[27744]: cluster 1689213826.2397206 mgr.a (mgr.14152) 1114 : cluster 0 pgmap v990: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:48.110 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:03:48.411 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:48 smithi022 bash[26979]: audit 1689213828.1168764 mon.d (mon.3) 17 : audit 0 from='client.? 172.21.15.22:0/1613000236' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:48.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:48 smithi103 bash[27315]: audit 1689213828.1168764 mon.d (mon.3) 17 : audit 0 from='client.? 172.21.15.22:0/1613000236' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:48.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:48 smithi084 bash[27323]: audit 1689213828.1168764 mon.d (mon.3) 17 : audit 0 from='client.? 172.21.15.22:0/1613000236' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:48.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:48 smithi154 bash[27744]: audit 1689213828.1168764 mon.d (mon.3) 17 : audit 0 from='client.? 172.21.15.22:0/1613000236' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:48.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:48 smithi137 bash[27262]: audit 1689213828.1168764 mon.d (mon.3) 17 : audit 0 from='client.? 172.21.15.22:0/1613000236' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:48.807 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:49.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:49 smithi103 bash[27315]: cluster 1689213828.240272 mgr.a (mgr.14152) 1115 : cluster 0 pgmap v991: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:49.644 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:49 smithi084 bash[27323]: cluster 1689213828.240272 mgr.a (mgr.14152) 1115 : cluster 0 pgmap v991: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:49.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:49 smithi022 bash[26979]: cluster 1689213828.240272 mgr.a (mgr.14152) 1115 : cluster 0 pgmap v991: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:49.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:49 smithi154 bash[27744]: cluster 1689213828.240272 mgr.a (mgr.14152) 1115 : cluster 0 pgmap v991: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:49.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:49 smithi137 bash[27262]: cluster 1689213828.240272 mgr.a (mgr.14152) 1115 : cluster 0 pgmap v991: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:49.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:51.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:51 smithi154 bash[27744]: cluster 1689213830.2408168 mgr.a (mgr.14152) 1116 : cluster 0 pgmap v992: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:51.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:51 smithi137 bash[27262]: cluster 1689213830.2408168 mgr.a (mgr.14152) 1116 : cluster 0 pgmap v992: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:51.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:51 smithi103 bash[27315]: cluster 1689213830.2408168 mgr.a (mgr.14152) 1116 : cluster 0 pgmap v992: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:51.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:51 smithi084 bash[27323]: cluster 1689213830.2408168 mgr.a (mgr.14152) 1116 : cluster 0 pgmap v992: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:51.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:51 smithi022 bash[26979]: cluster 1689213830.2408168 mgr.a (mgr.14152) 1116 : cluster 0 pgmap v992: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:53.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:53 smithi137 bash[27262]: cluster 1689213832.241337 mgr.a (mgr.14152) 1117 : cluster 0 pgmap v993: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:53.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:53 smithi103 bash[27315]: cluster 1689213832.241337 mgr.a (mgr.14152) 1117 : cluster 0 pgmap v993: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:53.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:53 smithi084 bash[27323]: cluster 1689213832.241337 mgr.a (mgr.14152) 1117 : cluster 0 pgmap v993: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:53.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:53 smithi022 bash[26979]: cluster 1689213832.241337 mgr.a (mgr.14152) 1117 : cluster 0 pgmap v993: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:53.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:53 smithi154 bash[27744]: cluster 1689213832.241337 mgr.a (mgr.14152) 1117 : cluster 0 pgmap v993: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:54.504 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:03:55.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:55 smithi137 bash[27262]: cluster 1689213834.24187 mgr.a (mgr.14152) 1118 : cluster 0 pgmap v994: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:55.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:55 smithi022 bash[26979]: cluster 1689213834.24187 mgr.a (mgr.14152) 1118 : cluster 0 pgmap v994: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:55.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:55 smithi103 bash[27315]: cluster 1689213834.24187 mgr.a (mgr.14152) 1118 : cluster 0 pgmap v994: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:55.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:55 smithi084 bash[27323]: cluster 1689213834.24187 mgr.a (mgr.14152) 1118 : cluster 0 pgmap v994: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:55.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:55 smithi154 bash[27744]: cluster 1689213834.24187 mgr.a (mgr.14152) 1118 : cluster 0 pgmap v994: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:57.555 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:57 smithi137 bash[27262]: cluster 1689213836.2423792 mgr.a (mgr.14152) 1119 : cluster 0 pgmap v995: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:57.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:57 smithi103 bash[27315]: cluster 1689213836.2423792 mgr.a (mgr.14152) 1119 : cluster 0 pgmap v995: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:57.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:57 smithi084 bash[27323]: cluster 1689213836.2423792 mgr.a (mgr.14152) 1119 : cluster 0 pgmap v995: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:57.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:57 smithi022 bash[26979]: cluster 1689213836.2423792 mgr.a (mgr.14152) 1119 : cluster 0 pgmap v995: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:57.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:57 smithi154 bash[27744]: cluster 1689213836.2423792 mgr.a (mgr.14152) 1119 : cluster 0 pgmap v995: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:57.828 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:03:58.535 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:03:58.605 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:58 smithi103 bash[27315]: audit 1689213837.8349807 mon.c (mon.2) 23 : audit 0 from='client.? 172.21.15.22:0/1834232218' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:58.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:58 smithi084 bash[27323]: audit 1689213837.8349807 mon.c (mon.2) 23 : audit 0 from='client.? 172.21.15.22:0/1834232218' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:58.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:58 smithi022 bash[26979]: audit 1689213837.8349807 mon.c (mon.2) 23 : audit 0 from='client.? 172.21.15.22:0/1834232218' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:58.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:58 smithi154 bash[27744]: audit 1689213837.8349807 mon.c (mon.2) 23 : audit 0 from='client.? 172.21.15.22:0/1834232218' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:58.805 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:58 smithi137 bash[27262]: audit 1689213837.8349807 mon.c (mon.2) 23 : audit 0 from='client.? 172.21.15.22:0/1834232218' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:03:59.536 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:03:59.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:03:59 smithi103 bash[27315]: cluster 1689213838.2429502 mgr.a (mgr.14152) 1120 : cluster 0 pgmap v996: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:59.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:03:59 smithi084 bash[27323]: cluster 1689213838.2429502 mgr.a (mgr.14152) 1120 : cluster 0 pgmap v996: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:59.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:03:59 smithi022 bash[26979]: cluster 1689213838.2429502 mgr.a (mgr.14152) 1120 : cluster 0 pgmap v996: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:59.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:03:59 smithi154 bash[27744]: cluster 1689213838.2429502 mgr.a (mgr.14152) 1120 : cluster 0 pgmap v996: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:03:59.806 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:03:59 smithi137 bash[27262]: cluster 1689213838.2429502 mgr.a (mgr.14152) 1120 : cluster 0 pgmap v996: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:01.509 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:01 smithi154 bash[27744]: cluster 1689213840.2434576 mgr.a (mgr.14152) 1121 : cluster 0 pgmap v997: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:01.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:01 smithi137 bash[27262]: cluster 1689213840.2434576 mgr.a (mgr.14152) 1121 : cluster 0 pgmap v997: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:01.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:01 smithi103 bash[27315]: cluster 1689213840.2434576 mgr.a (mgr.14152) 1121 : cluster 0 pgmap v997: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:01.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:01 smithi084 bash[27323]: cluster 1689213840.2434576 mgr.a (mgr.14152) 1121 : cluster 0 pgmap v997: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:01.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:01 smithi022 bash[26979]: cluster 1689213840.2434576 mgr.a (mgr.14152) 1121 : cluster 0 pgmap v997: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:03.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:03 smithi137 bash[27262]: cluster 1689213842.2439563 mgr.a (mgr.14152) 1122 : cluster 0 pgmap v998: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:03.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:03 smithi103 bash[27315]: cluster 1689213842.2439563 mgr.a (mgr.14152) 1122 : cluster 0 pgmap v998: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:03.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:03 smithi084 bash[27323]: cluster 1689213842.2439563 mgr.a (mgr.14152) 1122 : cluster 0 pgmap v998: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:03.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:03 smithi022 bash[26979]: cluster 1689213842.2439563 mgr.a (mgr.14152) 1122 : cluster 0 pgmap v998: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:03.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:03 smithi154 bash[27744]: cluster 1689213842.2439563 mgr.a (mgr.14152) 1122 : cluster 0 pgmap v998: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:04.234 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:04:05.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:05 smithi022 bash[26979]: cluster 1689213844.2444048 mgr.a (mgr.14152) 1123 : cluster 0 pgmap v999: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:05.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:05 smithi137 bash[27262]: cluster 1689213844.2444048 mgr.a (mgr.14152) 1123 : cluster 0 pgmap v999: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:05.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:05 smithi103 bash[27315]: cluster 1689213844.2444048 mgr.a (mgr.14152) 1123 : cluster 0 pgmap v999: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:05.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:05 smithi084 bash[27323]: cluster 1689213844.2444048 mgr.a (mgr.14152) 1123 : cluster 0 pgmap v999: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:05.759 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:05 smithi154 bash[27744]: cluster 1689213844.2444048 mgr.a (mgr.14152) 1123 : cluster 0 pgmap v999: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:07.442 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:04:07.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:07 smithi137 bash[27262]: cluster 1689213846.2449512 mgr.a (mgr.14152) 1124 : cluster 0 pgmap v1000: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:07.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:07 smithi103 bash[27315]: cluster 1689213846.2449512 mgr.a (mgr.14152) 1124 : cluster 0 pgmap v1000: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:07.643 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:07 smithi022 bash[26979]: cluster 1689213846.2449512 mgr.a (mgr.14152) 1124 : cluster 0 pgmap v1000: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:07.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:07 smithi084 bash[27323]: cluster 1689213846.2449512 mgr.a (mgr.14152) 1124 : cluster 0 pgmap v1000: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:07.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:07 smithi154 bash[27744]: cluster 1689213846.2449512 mgr.a (mgr.14152) 1124 : cluster 0 pgmap v1000: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:08.198 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:04:08.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:08 smithi137 bash[27262]: audit 1689213847.4460576 mon.a (mon.0) 1190 : audit 0 from='client.? 172.21.15.22:0/4269541038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:08.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:08 smithi103 bash[27315]: audit 1689213847.4460576 mon.a (mon.0) 1190 : audit 0 from='client.? 172.21.15.22:0/4269541038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:08.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:08 smithi084 bash[27323]: audit 1689213847.4460576 mon.a (mon.0) 1190 : audit 0 from='client.? 172.21.15.22:0/4269541038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:08.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:08 smithi022 bash[26979]: audit 1689213847.4460576 mon.a (mon.0) 1190 : audit 0 from='client.? 172.21.15.22:0/4269541038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:08.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:08 smithi154 bash[27744]: audit 1689213847.4460576 mon.a (mon.0) 1190 : audit 0 from='client.? 172.21.15.22:0/4269541038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:09.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:04:09.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:09 smithi103 bash[27315]: cluster 1689213848.245507 mgr.a (mgr.14152) 1125 : cluster 0 pgmap v1001: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:09.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:09 smithi084 bash[27323]: cluster 1689213848.245507 mgr.a (mgr.14152) 1125 : cluster 0 pgmap v1001: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:09.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:09 smithi022 bash[26979]: cluster 1689213848.245507 mgr.a (mgr.14152) 1125 : cluster 0 pgmap v1001: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:09.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:09 smithi154 bash[27744]: cluster 1689213848.245507 mgr.a (mgr.14152) 1125 : cluster 0 pgmap v1001: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:09.806 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:09 smithi137 bash[27262]: cluster 1689213848.245507 mgr.a (mgr.14152) 1125 : cluster 0 pgmap v1001: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:11.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:11 smithi154 bash[27744]: cluster 1689213850.2460406 mgr.a (mgr.14152) 1126 : cluster 0 pgmap v1002: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:11.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:11 smithi137 bash[27262]: cluster 1689213850.2460406 mgr.a (mgr.14152) 1126 : cluster 0 pgmap v1002: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:11.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:11 smithi103 bash[27315]: cluster 1689213850.2460406 mgr.a (mgr.14152) 1126 : cluster 0 pgmap v1002: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:11.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:11 smithi084 bash[27323]: cluster 1689213850.2460406 mgr.a (mgr.14152) 1126 : cluster 0 pgmap v1002: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:11.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:11 smithi022 bash[26979]: cluster 1689213850.2460406 mgr.a (mgr.14152) 1126 : cluster 0 pgmap v1002: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:13.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:13 smithi137 bash[27262]: cluster 1689213852.246581 mgr.a (mgr.14152) 1127 : cluster 0 pgmap v1003: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:13.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:13 smithi103 bash[27315]: cluster 1689213852.246581 mgr.a (mgr.14152) 1127 : cluster 0 pgmap v1003: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:13.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:13 smithi084 bash[27323]: cluster 1689213852.246581 mgr.a (mgr.14152) 1127 : cluster 0 pgmap v1003: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:13.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:13 smithi022 bash[26979]: cluster 1689213852.246581 mgr.a (mgr.14152) 1127 : cluster 0 pgmap v1003: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:13.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:13 smithi154 bash[27744]: cluster 1689213852.246581 mgr.a (mgr.14152) 1127 : cluster 0 pgmap v1003: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:13.895 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:04:15.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:15 smithi137 bash[27262]: cluster 1689213854.2471163 mgr.a (mgr.14152) 1128 : cluster 0 pgmap v1004: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:15.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:15 smithi103 bash[27315]: cluster 1689213854.2471163 mgr.a (mgr.14152) 1128 : cluster 0 pgmap v1004: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:15.645 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:15 smithi084 bash[27323]: cluster 1689213854.2471163 mgr.a (mgr.14152) 1128 : cluster 0 pgmap v1004: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:15.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:15 smithi022 bash[26979]: cluster 1689213854.2471163 mgr.a (mgr.14152) 1128 : cluster 0 pgmap v1004: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:15.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:15 smithi154 bash[27744]: cluster 1689213854.2471163 mgr.a (mgr.14152) 1128 : cluster 0 pgmap v1004: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:17.166 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:04:17.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:17 smithi103 bash[27315]: cluster 1689213856.2476583 mgr.a (mgr.14152) 1129 : cluster 0 pgmap v1005: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:17.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:17 smithi103 bash[27315]: audit 1689213857.1745846 mon.e (mon.1) 23 : audit 0 from='client.? 172.21.15.22:0/1117693113' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:17.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:17 smithi084 bash[27323]: cluster 1689213856.2476583 mgr.a (mgr.14152) 1129 : cluster 0 pgmap v1005: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:17.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:17 smithi084 bash[27323]: audit 1689213857.1745846 mon.e (mon.1) 23 : audit 0 from='client.? 172.21.15.22:0/1117693113' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:17.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:17 smithi022 bash[26979]: cluster 1689213856.2476583 mgr.a (mgr.14152) 1129 : cluster 0 pgmap v1005: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:17.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:17 smithi022 bash[26979]: audit 1689213857.1745846 mon.e (mon.1) 23 : audit 0 from='client.? 172.21.15.22:0/1117693113' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:17.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:17 smithi154 bash[27744]: cluster 1689213856.2476583 mgr.a (mgr.14152) 1129 : cluster 0 pgmap v1005: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:17.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:17 smithi154 bash[27744]: audit 1689213857.1745846 mon.e (mon.1) 23 : audit 0 from='client.? 172.21.15.22:0/1117693113' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:17.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:17 smithi137 bash[27262]: cluster 1689213856.2476583 mgr.a (mgr.14152) 1129 : cluster 0 pgmap v1005: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:17.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:17 smithi137 bash[27262]: audit 1689213857.1745846 mon.e (mon.1) 23 : audit 0 from='client.? 172.21.15.22:0/1117693113' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:17.971 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:04:18.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:04:19.606 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:19 smithi103 bash[27315]: cluster 1689213858.248181 mgr.a (mgr.14152) 1130 : cluster 0 pgmap v1006: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:19.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:19 smithi084 bash[27323]: cluster 1689213858.248181 mgr.a (mgr.14152) 1130 : cluster 0 pgmap v1006: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:19.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:19 smithi022 bash[26979]: cluster 1689213858.248181 mgr.a (mgr.14152) 1130 : cluster 0 pgmap v1006: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:19.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:19 smithi154 bash[27744]: cluster 1689213858.248181 mgr.a (mgr.14152) 1130 : cluster 0 pgmap v1006: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:19.806 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:19 smithi137 bash[27262]: cluster 1689213858.248181 mgr.a (mgr.14152) 1130 : cluster 0 pgmap v1006: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:21.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:21 smithi154 bash[27744]: cluster 1689213860.248727 mgr.a (mgr.14152) 1131 : cluster 0 pgmap v1007: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:21.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:21 smithi137 bash[27262]: cluster 1689213860.248727 mgr.a (mgr.14152) 1131 : cluster 0 pgmap v1007: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:21.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:21 smithi103 bash[27315]: cluster 1689213860.248727 mgr.a (mgr.14152) 1131 : cluster 0 pgmap v1007: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:21.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:21 smithi084 bash[27323]: cluster 1689213860.248727 mgr.a (mgr.14152) 1131 : cluster 0 pgmap v1007: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:21.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:21 smithi022 bash[26979]: cluster 1689213860.248727 mgr.a (mgr.14152) 1131 : cluster 0 pgmap v1007: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:23.556 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:23 smithi137 bash[27262]: cluster 1689213862.2492864 mgr.a (mgr.14152) 1132 : cluster 0 pgmap v1008: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:23.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:23 smithi103 bash[27315]: cluster 1689213862.2492864 mgr.a (mgr.14152) 1132 : cluster 0 pgmap v1008: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:23.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:23 smithi084 bash[27323]: cluster 1689213862.2492864 mgr.a (mgr.14152) 1132 : cluster 0 pgmap v1008: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:23.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:23 smithi022 bash[26979]: cluster 1689213862.2492864 mgr.a (mgr.14152) 1132 : cluster 0 pgmap v1008: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:23.673 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:04:23.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:23 smithi154 bash[27744]: cluster 1689213862.2492864 mgr.a (mgr.14152) 1132 : cluster 0 pgmap v1008: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:25.604 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:25 smithi022 bash[26979]: cluster 1689213864.2498329 mgr.a (mgr.14152) 1133 : cluster 0 pgmap v1009: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:25.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:25 smithi103 bash[27315]: cluster 1689213864.2498329 mgr.a (mgr.14152) 1133 : cluster 0 pgmap v1009: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:25.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:25 smithi084 bash[27323]: cluster 1689213864.2498329 mgr.a (mgr.14152) 1133 : cluster 0 pgmap v1009: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:25.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:25 smithi154 bash[27744]: cluster 1689213864.2498329 mgr.a (mgr.14152) 1133 : cluster 0 pgmap v1009: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:25.806 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:25 smithi137 bash[27262]: cluster 1689213864.2498329 mgr.a (mgr.14152) 1133 : cluster 0 pgmap v1009: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:27.033 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:04:27.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:27 smithi022 bash[26979]: cluster 1689213866.2503777 mgr.a (mgr.14152) 1134 : cluster 0 pgmap v1010: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:27.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:27 smithi022 bash[26979]: audit 1689213866.4106727 mon.a (mon.0) 1191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:04:27.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:27 smithi022 bash[26979]: audit 1689213866.8391826 mon.a (mon.0) 1192 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:27 smithi022 bash[26979]: audit 1689213866.8453748 mon.a (mon.0) 1193 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:27 smithi022 bash[26979]: audit 1689213867.038151 mon.b (mon.4) 31 : audit 0 from='client.? 172.21.15.22:0/552019012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:27.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:27 smithi103 bash[27315]: cluster 1689213866.2503777 mgr.a (mgr.14152) 1134 : cluster 0 pgmap v1010: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:27.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:27 smithi103 bash[27315]: audit 1689213866.4106727 mon.a (mon.0) 1191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:04:27.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:27 smithi103 bash[27315]: audit 1689213866.8391826 mon.a (mon.0) 1192 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:27 smithi103 bash[27315]: audit 1689213866.8453748 mon.a (mon.0) 1193 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:27 smithi103 bash[27315]: audit 1689213867.038151 mon.b (mon.4) 31 : audit 0 from='client.? 172.21.15.22:0/552019012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:27.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:27 smithi084 bash[27323]: cluster 1689213866.2503777 mgr.a (mgr.14152) 1134 : cluster 0 pgmap v1010: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:27.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:27 smithi084 bash[27323]: audit 1689213866.4106727 mon.a (mon.0) 1191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:04:27.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:27 smithi084 bash[27323]: audit 1689213866.8391826 mon.a (mon.0) 1192 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:27 smithi084 bash[27323]: audit 1689213866.8453748 mon.a (mon.0) 1193 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:27 smithi084 bash[27323]: audit 1689213867.038151 mon.b (mon.4) 31 : audit 0 from='client.? 172.21.15.22:0/552019012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:27.750 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:04:27.760 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:27 smithi154 bash[27744]: cluster 1689213866.2503777 mgr.a (mgr.14152) 1134 : cluster 0 pgmap v1010: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:27.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:27 smithi154 bash[27744]: audit 1689213866.4106727 mon.a (mon.0) 1191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:04:27.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:27 smithi154 bash[27744]: audit 1689213866.8391826 mon.a (mon.0) 1192 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:27 smithi154 bash[27744]: audit 1689213866.8453748 mon.a (mon.0) 1193 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:27 smithi154 bash[27744]: audit 1689213867.038151 mon.b (mon.4) 31 : audit 0 from='client.? 172.21.15.22:0/552019012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:27.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:27 smithi137 bash[27262]: cluster 1689213866.2503777 mgr.a (mgr.14152) 1134 : cluster 0 pgmap v1010: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:27.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:27 smithi137 bash[27262]: audit 1689213866.4106727 mon.a (mon.0) 1191 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:04:27.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:27 smithi137 bash[27262]: audit 1689213866.8391826 mon.a (mon.0) 1192 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:27 smithi137 bash[27262]: audit 1689213866.8453748 mon.a (mon.0) 1193 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:27.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:27 smithi137 bash[27262]: audit 1689213867.038151 mon.b (mon.4) 31 : audit 0 from='client.? 172.21.15.22:0/552019012' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:28.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:04:28.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.529705 mon.a (mon.0) 1194 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.5353935 mon.a (mon.0) 1195 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.807 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.541347 mon.a (mon.0) 1196 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.5493827 mon.a (mon.0) 1197 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.978516 mon.a (mon.0) 1198 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.986057 mon.a (mon.0) 1199 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.9873571 mon.a (mon.0) 1200 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.9886236 mon.a (mon.0) 1201 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: cluster 1689213867.99124 mgr.a (mgr.14152) 1135 : cluster 0 pgmap v1011: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: cluster 1689213867.9914525 mgr.a (mgr.14152) 1136 : cluster 0 pgmap v1012: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:28 smithi137 bash[27262]: audit 1689213867.997259 mon.a (mon.0) 1202 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.529705 mon.a (mon.0) 1194 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.5353935 mon.a (mon.0) 1195 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.857 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.541347 mon.a (mon.0) 1196 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.5493827 mon.a (mon.0) 1197 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.978516 mon.a (mon.0) 1198 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.986057 mon.a (mon.0) 1199 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.9873571 mon.a (mon.0) 1200 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.9886236 mon.a (mon.0) 1201 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: cluster 1689213867.99124 mgr.a (mgr.14152) 1135 : cluster 0 pgmap v1011: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.858 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: cluster 1689213867.9914525 mgr.a (mgr.14152) 1136 : cluster 0 pgmap v1012: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:28 smithi103 bash[27315]: audit 1689213867.997259 mon.a (mon.0) 1202 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.529705 mon.a (mon.0) 1194 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.896 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.5353935 mon.a (mon.0) 1195 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.541347 mon.a (mon.0) 1196 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.5493827 mon.a (mon.0) 1197 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.978516 mon.a (mon.0) 1198 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.986057 mon.a (mon.0) 1199 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.9873571 mon.a (mon.0) 1200 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.9886236 mon.a (mon.0) 1201 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:04:28.897 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: cluster 1689213867.99124 mgr.a (mgr.14152) 1135 : cluster 0 pgmap v1011: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: cluster 1689213867.9914525 mgr.a (mgr.14152) 1136 : cluster 0 pgmap v1012: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:28 smithi084 bash[27323]: audit 1689213867.997259 mon.a (mon.0) 1202 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.529705 mon.a (mon.0) 1194 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.5353935 mon.a (mon.0) 1195 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.541347 mon.a (mon.0) 1196 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.5493827 mon.a (mon.0) 1197 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.978516 mon.a (mon.0) 1198 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.986057 mon.a (mon.0) 1199 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:28.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.9873571 mon.a (mon.0) 1200 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:04:28.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.9886236 mon.a (mon.0) 1201 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:04:28.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: cluster 1689213867.99124 mgr.a (mgr.14152) 1135 : cluster 0 pgmap v1011: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: cluster 1689213867.9914525 mgr.a (mgr.14152) 1136 : cluster 0 pgmap v1012: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:28.913 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:28 smithi022 bash[26979]: audit 1689213867.997259 mon.a (mon.0) 1202 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.529705 mon.a (mon.0) 1194 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.5353935 mon.a (mon.0) 1195 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.541347 mon.a (mon.0) 1196 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.5493827 mon.a (mon.0) 1197 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.011 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.978516 mon.a (mon.0) 1198 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.986057 mon.a (mon.0) 1199 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:29.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.9873571 mon.a (mon.0) 1200 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:04:29.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.9886236 mon.a (mon.0) 1201 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:04:29.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: cluster 1689213867.99124 mgr.a (mgr.14152) 1135 : cluster 0 pgmap v1011: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:29.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: cluster 1689213867.9914525 mgr.a (mgr.14152) 1136 : cluster 0 pgmap v1012: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:29.012 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:28 smithi154 bash[27744]: audit 1689213867.997259 mon.a (mon.0) 1202 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:04:31.510 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:31 smithi154 bash[27744]: cluster 1689213869.9919415 mgr.a (mgr.14152) 1137 : cluster 0 pgmap v1013: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:31.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:31 smithi137 bash[27262]: cluster 1689213869.9919415 mgr.a (mgr.14152) 1137 : cluster 0 pgmap v1013: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:31.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:31 smithi103 bash[27315]: cluster 1689213869.9919415 mgr.a (mgr.14152) 1137 : cluster 0 pgmap v1013: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:31.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:31 smithi084 bash[27323]: cluster 1689213869.9919415 mgr.a (mgr.14152) 1137 : cluster 0 pgmap v1013: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:31.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:31 smithi022 bash[26979]: cluster 1689213869.9919415 mgr.a (mgr.14152) 1137 : cluster 0 pgmap v1013: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:33.443 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:04:33.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:33 smithi154 bash[27744]: cluster 1689213871.9924788 mgr.a (mgr.14152) 1138 : cluster 0 pgmap v1014: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:33.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:33 smithi137 bash[27262]: cluster 1689213871.9924788 mgr.a (mgr.14152) 1138 : cluster 0 pgmap v1014: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:33.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:33 smithi103 bash[27315]: cluster 1689213871.9924788 mgr.a (mgr.14152) 1138 : cluster 0 pgmap v1014: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:33.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:33 smithi084 bash[27323]: cluster 1689213871.9924788 mgr.a (mgr.14152) 1138 : cluster 0 pgmap v1014: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:33.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:33 smithi022 bash[26979]: cluster 1689213871.9924788 mgr.a (mgr.14152) 1138 : cluster 0 pgmap v1014: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:35.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:35 smithi022 bash[26979]: cluster 1689213873.9930153 mgr.a (mgr.14152) 1139 : cluster 0 pgmap v1015: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:35.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:35 smithi154 bash[27744]: cluster 1689213873.9930153 mgr.a (mgr.14152) 1139 : cluster 0 pgmap v1015: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:35.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:35 smithi137 bash[27262]: cluster 1689213873.9930153 mgr.a (mgr.14152) 1139 : cluster 0 pgmap v1015: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:35.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:35 smithi103 bash[27315]: cluster 1689213873.9930153 mgr.a (mgr.14152) 1139 : cluster 0 pgmap v1015: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:35.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:35 smithi084 bash[27323]: cluster 1689213873.9930153 mgr.a (mgr.14152) 1139 : cluster 0 pgmap v1015: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:36.836 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:04:37.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:37 smithi022 bash[26979]: cluster 1689213875.9936295 mgr.a (mgr.14152) 1140 : cluster 0 pgmap v1016: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:37.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:37 smithi022 bash[26979]: audit 1689213876.8412669 mon.b (mon.4) 32 : audit 0 from='client.? 172.21.15.22:0/3348386298' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:37.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:37 smithi154 bash[27744]: cluster 1689213875.9936295 mgr.a (mgr.14152) 1140 : cluster 0 pgmap v1016: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:37.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:37 smithi154 bash[27744]: audit 1689213876.8412669 mon.b (mon.4) 32 : audit 0 from='client.? 172.21.15.22:0/3348386298' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:37.526 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:04:37.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:37 smithi137 bash[27262]: cluster 1689213875.9936295 mgr.a (mgr.14152) 1140 : cluster 0 pgmap v1016: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:37.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:37 smithi137 bash[27262]: audit 1689213876.8412669 mon.b (mon.4) 32 : audit 0 from='client.? 172.21.15.22:0/3348386298' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:37.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:37 smithi103 bash[27315]: cluster 1689213875.9936295 mgr.a (mgr.14152) 1140 : cluster 0 pgmap v1016: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:37.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:37 smithi103 bash[27315]: audit 1689213876.8412669 mon.b (mon.4) 32 : audit 0 from='client.? 172.21.15.22:0/3348386298' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:37.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:37 smithi084 bash[27323]: cluster 1689213875.9936295 mgr.a (mgr.14152) 1140 : cluster 0 pgmap v1016: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:37.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:37 smithi084 bash[27323]: audit 1689213876.8412669 mon.b (mon.4) 32 : audit 0 from='client.? 172.21.15.22:0/3348386298' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:38.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:04:39.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:39 smithi154 bash[27744]: cluster 1689213877.9941888 mgr.a (mgr.14152) 1141 : cluster 0 pgmap v1017: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:39.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:39 smithi137 bash[27262]: cluster 1689213877.9941888 mgr.a (mgr.14152) 1141 : cluster 0 pgmap v1017: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:39.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:39 smithi103 bash[27315]: cluster 1689213877.9941888 mgr.a (mgr.14152) 1141 : cluster 0 pgmap v1017: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:39.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:39 smithi084 bash[27323]: cluster 1689213877.9941888 mgr.a (mgr.14152) 1141 : cluster 0 pgmap v1017: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:39.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:39 smithi022 bash[26979]: cluster 1689213877.9941888 mgr.a (mgr.14152) 1141 : cluster 0 pgmap v1017: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:41.511 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:41 smithi154 bash[27744]: cluster 1689213879.994778 mgr.a (mgr.14152) 1142 : cluster 0 pgmap v1018: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:41.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:41 smithi137 bash[27262]: cluster 1689213879.994778 mgr.a (mgr.14152) 1142 : cluster 0 pgmap v1018: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:41.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:41 smithi103 bash[27315]: cluster 1689213879.994778 mgr.a (mgr.14152) 1142 : cluster 0 pgmap v1018: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:41.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:41 smithi084 bash[27323]: cluster 1689213879.994778 mgr.a (mgr.14152) 1142 : cluster 0 pgmap v1018: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:41.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:41 smithi022 bash[26979]: cluster 1689213879.994778 mgr.a (mgr.14152) 1142 : cluster 0 pgmap v1018: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:43.225 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:04:43.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:43 smithi137 bash[27262]: cluster 1689213881.995361 mgr.a (mgr.14152) 1143 : cluster 0 pgmap v1019: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:43.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:43 smithi103 bash[27315]: cluster 1689213881.995361 mgr.a (mgr.14152) 1143 : cluster 0 pgmap v1019: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:43.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:43 smithi084 bash[27323]: cluster 1689213881.995361 mgr.a (mgr.14152) 1143 : cluster 0 pgmap v1019: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:43.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:43 smithi022 bash[26979]: cluster 1689213881.995361 mgr.a (mgr.14152) 1143 : cluster 0 pgmap v1019: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:43.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:43 smithi154 bash[27744]: cluster 1689213881.995361 mgr.a (mgr.14152) 1143 : cluster 0 pgmap v1019: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:45.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:45 smithi137 bash[27262]: cluster 1689213883.9960139 mgr.a (mgr.14152) 1144 : cluster 0 pgmap v1020: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:45.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:45 smithi103 bash[27315]: cluster 1689213883.9960139 mgr.a (mgr.14152) 1144 : cluster 0 pgmap v1020: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:45.646 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:45 smithi084 bash[27323]: cluster 1689213883.9960139 mgr.a (mgr.14152) 1144 : cluster 0 pgmap v1020: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:45.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:45 smithi022 bash[26979]: cluster 1689213883.9960139 mgr.a (mgr.14152) 1144 : cluster 0 pgmap v1020: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:45.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:45 smithi154 bash[27744]: cluster 1689213883.9960139 mgr.a (mgr.14152) 1144 : cluster 0 pgmap v1020: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:04:47.297 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:04:47.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:47 smithi137 bash[27262]: cluster 1689213885.9965334 mgr.a (mgr.14152) 1145 : cluster 0 pgmap v1021: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:47.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:47 smithi137 bash[27262]: audit 1689213886.5173702 mon.d (mon.3) 18 : audit 0 from='client.? 172.21.15.22:0/2081586138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:47.607 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:47 smithi103 bash[27315]: cluster 1689213885.9965334 mgr.a (mgr.14152) 1145 : cluster 0 pgmap v1021: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:47.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:47 smithi103 bash[27315]: audit 1689213886.5173702 mon.d (mon.3) 18 : audit 0 from='client.? 172.21.15.22:0/2081586138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:47.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:47 smithi084 bash[27323]: cluster 1689213885.9965334 mgr.a (mgr.14152) 1145 : cluster 0 pgmap v1021: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:47.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:47 smithi084 bash[27323]: audit 1689213886.5173702 mon.d (mon.3) 18 : audit 0 from='client.? 172.21.15.22:0/2081586138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:47.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:47 smithi022 bash[26979]: cluster 1689213885.9965334 mgr.a (mgr.14152) 1145 : cluster 0 pgmap v1021: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:47.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:47 smithi022 bash[26979]: audit 1689213886.5173702 mon.d (mon.3) 18 : audit 0 from='client.? 172.21.15.22:0/2081586138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:47.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:47 smithi154 bash[27744]: cluster 1689213885.9965334 mgr.a (mgr.14152) 1145 : cluster 0 pgmap v1021: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:47.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:47 smithi154 bash[27744]: audit 1689213886.5173702 mon.d (mon.3) 18 : audit 0 from='client.? 172.21.15.22:0/2081586138' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:48.299 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:04:49.557 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:49 smithi137 bash[27262]: cluster 1689213887.9971242 mgr.a (mgr.14152) 1146 : cluster 0 pgmap v1022: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:49.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:49 smithi103 bash[27315]: cluster 1689213887.9971242 mgr.a (mgr.14152) 1146 : cluster 0 pgmap v1022: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:49.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:49 smithi084 bash[27323]: cluster 1689213887.9971242 mgr.a (mgr.14152) 1146 : cluster 0 pgmap v1022: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:49.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:49 smithi022 bash[26979]: cluster 1689213887.9971242 mgr.a (mgr.14152) 1146 : cluster 0 pgmap v1022: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:49.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:49 smithi154 bash[27744]: cluster 1689213887.9971242 mgr.a (mgr.14152) 1146 : cluster 0 pgmap v1022: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:51.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:51 smithi137 bash[27262]: cluster 1689213889.9976785 mgr.a (mgr.14152) 1147 : cluster 0 pgmap v1023: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:51.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:51 smithi103 bash[27315]: cluster 1689213889.9976785 mgr.a (mgr.14152) 1147 : cluster 0 pgmap v1023: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:51.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:51 smithi084 bash[27323]: cluster 1689213889.9976785 mgr.a (mgr.14152) 1147 : cluster 0 pgmap v1023: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:51.662 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:51 smithi022 bash[26979]: cluster 1689213889.9976785 mgr.a (mgr.14152) 1147 : cluster 0 pgmap v1023: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:51.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:51 smithi154 bash[27744]: cluster 1689213889.9976785 mgr.a (mgr.14152) 1147 : cluster 0 pgmap v1023: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:52.991 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:04:53.412 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:53 smithi022 bash[26979]: cluster 1689213891.9981735 mgr.a (mgr.14152) 1148 : cluster 0 pgmap v1024: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:53.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:53 smithi137 bash[27262]: cluster 1689213891.9981735 mgr.a (mgr.14152) 1148 : cluster 0 pgmap v1024: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:53.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:53 smithi103 bash[27315]: cluster 1689213891.9981735 mgr.a (mgr.14152) 1148 : cluster 0 pgmap v1024: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:53.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:53 smithi084 bash[27323]: cluster 1689213891.9981735 mgr.a (mgr.14152) 1148 : cluster 0 pgmap v1024: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:53.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:53 smithi154 bash[27744]: cluster 1689213891.9981735 mgr.a (mgr.14152) 1148 : cluster 0 pgmap v1024: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:55.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:55 smithi022 bash[26979]: cluster 1689213893.9987082 mgr.a (mgr.14152) 1149 : cluster 0 pgmap v1025: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:55.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:55 smithi137 bash[27262]: cluster 1689213893.9987082 mgr.a (mgr.14152) 1149 : cluster 0 pgmap v1025: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:55.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:55 smithi103 bash[27315]: cluster 1689213893.9987082 mgr.a (mgr.14152) 1149 : cluster 0 pgmap v1025: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:55.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:55 smithi084 bash[27323]: cluster 1689213893.9987082 mgr.a (mgr.14152) 1149 : cluster 0 pgmap v1025: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:55.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:55 smithi154 bash[27744]: cluster 1689213893.9987082 mgr.a (mgr.14152) 1149 : cluster 0 pgmap v1025: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:56.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:04:57.098 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:04:57.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:57 smithi022 bash[26979]: cluster 1689213895.9992628 mgr.a (mgr.14152) 1150 : cluster 0 pgmap v1026: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:57.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:57 smithi022 bash[26979]: audit 1689213896.4006035 mon.a (mon.0) 1203 : audit 0 from='client.? 172.21.15.22:0/2174752152' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:57.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:57 smithi137 bash[27262]: cluster 1689213895.9992628 mgr.a (mgr.14152) 1150 : cluster 0 pgmap v1026: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:57.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:57 smithi137 bash[27262]: audit 1689213896.4006035 mon.a (mon.0) 1203 : audit 0 from='client.? 172.21.15.22:0/2174752152' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:57.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:57 smithi103 bash[27315]: cluster 1689213895.9992628 mgr.a (mgr.14152) 1150 : cluster 0 pgmap v1026: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:57.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:57 smithi103 bash[27315]: audit 1689213896.4006035 mon.a (mon.0) 1203 : audit 0 from='client.? 172.21.15.22:0/2174752152' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:57.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:57 smithi084 bash[27323]: cluster 1689213895.9992628 mgr.a (mgr.14152) 1150 : cluster 0 pgmap v1026: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:57.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:57 smithi084 bash[27323]: audit 1689213896.4006035 mon.a (mon.0) 1203 : audit 0 from='client.? 172.21.15.22:0/2174752152' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:57.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:57 smithi154 bash[27744]: cluster 1689213895.9992628 mgr.a (mgr.14152) 1150 : cluster 0 pgmap v1026: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:57.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:57 smithi154 bash[27744]: audit 1689213896.4006035 mon.a (mon.0) 1203 : audit 0 from='client.? 172.21.15.22:0/2174752152' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:04:58.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:04:59.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:04:59 smithi137 bash[27262]: cluster 1689213897.9997616 mgr.a (mgr.14152) 1151 : cluster 0 pgmap v1027: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:59.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:04:59 smithi103 bash[27315]: cluster 1689213897.9997616 mgr.a (mgr.14152) 1151 : cluster 0 pgmap v1027: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:59.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:04:59 smithi084 bash[27323]: cluster 1689213897.9997616 mgr.a (mgr.14152) 1151 : cluster 0 pgmap v1027: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:59.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:04:59 smithi022 bash[26979]: cluster 1689213897.9997616 mgr.a (mgr.14152) 1151 : cluster 0 pgmap v1027: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:04:59.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:04:59 smithi154 bash[27744]: cluster 1689213897.9997616 mgr.a (mgr.14152) 1151 : cluster 0 pgmap v1027: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:01.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:01 smithi137 bash[27262]: cluster 1689213900.0002046 mgr.a (mgr.14152) 1152 : cluster 0 pgmap v1028: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:01.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:01 smithi103 bash[27315]: cluster 1689213900.0002046 mgr.a (mgr.14152) 1152 : cluster 0 pgmap v1028: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:01.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:01 smithi084 bash[27323]: cluster 1689213900.0002046 mgr.a (mgr.14152) 1152 : cluster 0 pgmap v1028: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:01.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:01 smithi022 bash[26979]: cluster 1689213900.0002046 mgr.a (mgr.14152) 1152 : cluster 0 pgmap v1028: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:01.761 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:01 smithi154 bash[27744]: cluster 1689213900.0002046 mgr.a (mgr.14152) 1152 : cluster 0 pgmap v1028: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:02.792 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:05:03.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:03 smithi137 bash[27262]: cluster 1689213902.000742 mgr.a (mgr.14152) 1153 : cluster 0 pgmap v1029: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:03.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:03 smithi103 bash[27315]: cluster 1689213902.000742 mgr.a (mgr.14152) 1153 : cluster 0 pgmap v1029: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:03.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:03 smithi084 bash[27323]: cluster 1689213902.000742 mgr.a (mgr.14152) 1153 : cluster 0 pgmap v1029: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:03.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:03 smithi022 bash[26979]: cluster 1689213902.000742 mgr.a (mgr.14152) 1153 : cluster 0 pgmap v1029: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:03.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:03 smithi154 bash[27744]: cluster 1689213902.000742 mgr.a (mgr.14152) 1153 : cluster 0 pgmap v1029: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:05.558 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:05 smithi137 bash[27262]: cluster 1689213904.0012975 mgr.a (mgr.14152) 1154 : cluster 0 pgmap v1030: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:05.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:05 smithi103 bash[27315]: cluster 1689213904.0012975 mgr.a (mgr.14152) 1154 : cluster 0 pgmap v1030: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:05.622 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:05 smithi022 bash[26979]: cluster 1689213904.0012975 mgr.a (mgr.14152) 1154 : cluster 0 pgmap v1030: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:05.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:05 smithi084 bash[27323]: cluster 1689213904.0012975 mgr.a (mgr.14152) 1154 : cluster 0 pgmap v1030: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:05.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:05 smithi154 bash[27744]: cluster 1689213904.0012975 mgr.a (mgr.14152) 1154 : cluster 0 pgmap v1030: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:06.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:05:06.439 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:06 smithi022 bash[26979]: audit 1689213906.0557828 mon.b (mon.4) 33 : audit 0 from='client.? 172.21.15.22:0/1617884310' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:06.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:06 smithi103 bash[27315]: audit 1689213906.0557828 mon.b (mon.4) 33 : audit 0 from='client.? 172.21.15.22:0/1617884310' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:06.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:06 smithi084 bash[27323]: audit 1689213906.0557828 mon.b (mon.4) 33 : audit 0 from='client.? 172.21.15.22:0/1617884310' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:06.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:06 smithi154 bash[27744]: audit 1689213906.0557828 mon.b (mon.4) 33 : audit 0 from='client.? 172.21.15.22:0/1617884310' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:06.803 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:05:06.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:06 smithi137 bash[27262]: audit 1689213906.0557828 mon.b (mon.4) 33 : audit 0 from='client.? 172.21.15.22:0/1617884310' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:07.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:07 smithi103 bash[27315]: cluster 1689213906.001783 mgr.a (mgr.14152) 1155 : cluster 0 pgmap v1031: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:07.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:07 smithi084 bash[27323]: cluster 1689213906.001783 mgr.a (mgr.14152) 1155 : cluster 0 pgmap v1031: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:07.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:07 smithi022 bash[26979]: cluster 1689213906.001783 mgr.a (mgr.14152) 1155 : cluster 0 pgmap v1031: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:07.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:07 smithi154 bash[27744]: cluster 1689213906.001783 mgr.a (mgr.14152) 1155 : cluster 0 pgmap v1031: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:07.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:05:07.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:07 smithi137 bash[27262]: cluster 1689213906.001783 mgr.a (mgr.14152) 1155 : cluster 0 pgmap v1031: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:09.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:09 smithi103 bash[27315]: cluster 1689213908.002298 mgr.a (mgr.14152) 1156 : cluster 0 pgmap v1032: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:09.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:09 smithi084 bash[27323]: cluster 1689213908.002298 mgr.a (mgr.14152) 1156 : cluster 0 pgmap v1032: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:09.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:09 smithi022 bash[26979]: cluster 1689213908.002298 mgr.a (mgr.14152) 1156 : cluster 0 pgmap v1032: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:09.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:09 smithi154 bash[27744]: cluster 1689213908.002298 mgr.a (mgr.14152) 1156 : cluster 0 pgmap v1032: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:09.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:09 smithi137 bash[27262]: cluster 1689213908.002298 mgr.a (mgr.14152) 1156 : cluster 0 pgmap v1032: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:11.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:11 smithi103 bash[27315]: cluster 1689213910.0027597 mgr.a (mgr.14152) 1157 : cluster 0 pgmap v1033: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:11.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:11 smithi084 bash[27323]: cluster 1689213910.0027597 mgr.a (mgr.14152) 1157 : cluster 0 pgmap v1033: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:11.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:11 smithi022 bash[26979]: cluster 1689213910.0027597 mgr.a (mgr.14152) 1157 : cluster 0 pgmap v1033: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:11.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:11 smithi154 bash[27744]: cluster 1689213910.0027597 mgr.a (mgr.14152) 1157 : cluster 0 pgmap v1033: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:11.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:11 smithi137 bash[27262]: cluster 1689213910.0027597 mgr.a (mgr.14152) 1157 : cluster 0 pgmap v1033: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:12.500 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:05:13.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:13 smithi103 bash[27315]: cluster 1689213912.003222 mgr.a (mgr.14152) 1158 : cluster 0 pgmap v1034: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:13.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:13 smithi084 bash[27323]: cluster 1689213912.003222 mgr.a (mgr.14152) 1158 : cluster 0 pgmap v1034: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:13.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:13 smithi022 bash[26979]: cluster 1689213912.003222 mgr.a (mgr.14152) 1158 : cluster 0 pgmap v1034: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:13.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:13 smithi154 bash[27744]: cluster 1689213912.003222 mgr.a (mgr.14152) 1158 : cluster 0 pgmap v1034: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:13.808 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:13 smithi137 bash[27262]: cluster 1689213912.003222 mgr.a (mgr.14152) 1158 : cluster 0 pgmap v1034: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:15.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:15 smithi103 bash[27315]: cluster 1689213914.003842 mgr.a (mgr.14152) 1159 : cluster 0 pgmap v1035: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:15.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:15 smithi084 bash[27323]: cluster 1689213914.003842 mgr.a (mgr.14152) 1159 : cluster 0 pgmap v1035: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:15.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:15 smithi022 bash[26979]: cluster 1689213914.003842 mgr.a (mgr.14152) 1159 : cluster 0 pgmap v1035: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:15.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:15 smithi154 bash[27744]: cluster 1689213914.003842 mgr.a (mgr.14152) 1159 : cluster 0 pgmap v1035: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:05:15.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:15 smithi137 bash[27262]: cluster 1689213914.003842 mgr.a (mgr.14152) 1159 : cluster 0 pgmap v1035: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:16.566 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:05:16.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:16 smithi103 bash[27315]: audit 1689213915.7758403 mon.a (mon.0) 1204 : audit 0 from='client.? 172.21.15.22:0/1364507918' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:16.647 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:16 smithi084 bash[27323]: audit 1689213915.7758403 mon.a (mon.0) 1204 : audit 0 from='client.? 172.21.15.22:0/1364507918' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:16.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:16 smithi022 bash[26979]: audit 1689213915.7758403 mon.a (mon.0) 1204 : audit 0 from='client.? 172.21.15.22:0/1364507918' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:16.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:16 smithi154 bash[27744]: audit 1689213915.7758403 mon.a (mon.0) 1204 : audit 0 from='client.? 172.21.15.22:0/1364507918' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:16.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:16 smithi137 bash[27262]: audit 1689213915.7758403 mon.a (mon.0) 1204 : audit 0 from='client.? 172.21.15.22:0/1364507918' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:17.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:05:17.608 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:17 smithi103 bash[27315]: cluster 1689213916.0044937 mgr.a (mgr.14152) 1160 : cluster 0 pgmap v1036: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:17.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:17 smithi084 bash[27323]: cluster 1689213916.0044937 mgr.a (mgr.14152) 1160 : cluster 0 pgmap v1036: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:17.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:17 smithi022 bash[26979]: cluster 1689213916.0044937 mgr.a (mgr.14152) 1160 : cluster 0 pgmap v1036: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:17.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:17 smithi154 bash[27744]: cluster 1689213916.0044937 mgr.a (mgr.14152) 1160 : cluster 0 pgmap v1036: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:17.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:17 smithi137 bash[27262]: cluster 1689213916.0044937 mgr.a (mgr.14152) 1160 : cluster 0 pgmap v1036: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:19.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:19 smithi103 bash[27315]: cluster 1689213918.0051603 mgr.a (mgr.14152) 1161 : cluster 0 pgmap v1037: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:19.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:19 smithi084 bash[27323]: cluster 1689213918.0051603 mgr.a (mgr.14152) 1161 : cluster 0 pgmap v1037: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:19.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:19 smithi022 bash[26979]: cluster 1689213918.0051603 mgr.a (mgr.14152) 1161 : cluster 0 pgmap v1037: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:19.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:19 smithi154 bash[27744]: cluster 1689213918.0051603 mgr.a (mgr.14152) 1161 : cluster 0 pgmap v1037: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:19.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:19 smithi137 bash[27262]: cluster 1689213918.0051603 mgr.a (mgr.14152) 1161 : cluster 0 pgmap v1037: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:21.609 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:21 smithi103 bash[27315]: cluster 1689213920.0057013 mgr.a (mgr.14152) 1162 : cluster 0 pgmap v1038: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:21.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:21 smithi084 bash[27323]: cluster 1689213920.0057013 mgr.a (mgr.14152) 1162 : cluster 0 pgmap v1038: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:21.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:21 smithi022 bash[26979]: cluster 1689213920.0057013 mgr.a (mgr.14152) 1162 : cluster 0 pgmap v1038: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:21.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:21 smithi154 bash[27744]: cluster 1689213920.0057013 mgr.a (mgr.14152) 1162 : cluster 0 pgmap v1038: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:21.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:21 smithi137 bash[27262]: cluster 1689213920.0057013 mgr.a (mgr.14152) 1162 : cluster 0 pgmap v1038: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:05:23.625 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:23 smithi022 bash[26979]: cluster 1689213922.0062487 mgr.a (mgr.14152) 1163 : cluster 0 pgmap v1039: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:23.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:23 smithi084 bash[27323]: cluster 1689213922.0062487 mgr.a (mgr.14152) 1163 : cluster 0 pgmap v1039: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:23.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:23 smithi154 bash[27744]: cluster 1689213922.0062487 mgr.a (mgr.14152) 1163 : cluster 0 pgmap v1039: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:23.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:23 smithi137 bash[27262]: cluster 1689213922.0062487 mgr.a (mgr.14152) 1163 : cluster 0 pgmap v1039: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:23.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:23 smithi103 bash[27315]: cluster 1689213922.0062487 mgr.a (mgr.14152) 1163 : cluster 0 pgmap v1039: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:25.525 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:05:25.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:25 smithi084 bash[27323]: cluster 1689213924.0068064 mgr.a (mgr.14152) 1164 : cluster 0 pgmap v1040: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:25.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:25 smithi022 bash[26979]: cluster 1689213924.0068064 mgr.a (mgr.14152) 1164 : cluster 0 pgmap v1040: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:25.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:25 smithi154 bash[27744]: cluster 1689213924.0068064 mgr.a (mgr.14152) 1164 : cluster 0 pgmap v1040: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:25.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:25 smithi137 bash[27262]: cluster 1689213924.0068064 mgr.a (mgr.14152) 1164 : cluster 0 pgmap v1040: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:25.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:25 smithi103 bash[27315]: cluster 1689213924.0068064 mgr.a (mgr.14152) 1164 : cluster 0 pgmap v1040: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:26.195 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:05:26.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:26 smithi084 bash[27323]: audit 1689213925.5271049 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.22:0/419916879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:26.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:26 smithi022 bash[26979]: audit 1689213925.5271049 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.22:0/419916879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:26.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:26 smithi154 bash[27744]: audit 1689213925.5271049 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.22:0/419916879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:26.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:26 smithi137 bash[27262]: audit 1689213925.5271049 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.22:0/419916879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:26.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:26 smithi103 bash[27315]: audit 1689213925.5271049 mon.a (mon.0) 1205 : audit 0 from='client.? 172.21.15.22:0/419916879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:27.197 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:05:27.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:27 smithi084 bash[27323]: cluster 1689213926.007175 mgr.a (mgr.14152) 1165 : cluster 0 pgmap v1041: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:27.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:27 smithi022 bash[26979]: cluster 1689213926.007175 mgr.a (mgr.14152) 1165 : cluster 0 pgmap v1041: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:27.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:27 smithi154 bash[27744]: cluster 1689213926.007175 mgr.a (mgr.14152) 1165 : cluster 0 pgmap v1041: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:27.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:27 smithi137 bash[27262]: cluster 1689213926.007175 mgr.a (mgr.14152) 1165 : cluster 0 pgmap v1041: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:27.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:27 smithi103 bash[27315]: cluster 1689213926.007175 mgr.a (mgr.14152) 1165 : cluster 0 pgmap v1041: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:28.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:28 smithi084 bash[27323]: audit 1689213928.1658108 mon.a (mon.0) 1206 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:05:28.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:28 smithi022 bash[26979]: audit 1689213928.1658108 mon.a (mon.0) 1206 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:05:28.762 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:28 smithi154 bash[27744]: audit 1689213928.1658108 mon.a (mon.0) 1206 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:05:28.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:28 smithi137 bash[27262]: audit 1689213928.1658108 mon.a (mon.0) 1206 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:05:28.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:28 smithi103 bash[27315]: audit 1689213928.1658108 mon.a (mon.0) 1206 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:05:29.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: cluster 1689213928.007665 mgr.a (mgr.14152) 1166 : cluster 0 pgmap v1042: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:29.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213928.5954938 mon.a (mon.0) 1207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213928.6086814 mon.a (mon.0) 1208 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.649 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.2279575 mon.a (mon.0) 1209 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.233635 mon.a (mon.0) 1210 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.2387047 mon.a (mon.0) 1211 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.2439137 mon.a (mon.0) 1212 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.3741949 mon.a (mon.0) 1213 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:05:29.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.375926 mon.a (mon.0) 1214 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:05:29.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:29 smithi084 bash[27323]: audit 1689213929.3866222 mon.a (mon.0) 1215 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: cluster 1689213928.007665 mgr.a (mgr.14152) 1166 : cluster 0 pgmap v1042: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:29.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213928.5954938 mon.a (mon.0) 1207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213928.6086814 mon.a (mon.0) 1208 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.2279575 mon.a (mon.0) 1209 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.233635 mon.a (mon.0) 1210 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.2387047 mon.a (mon.0) 1211 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.2439137 mon.a (mon.0) 1212 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.3741949 mon.a (mon.0) 1213 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:05:29.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.375926 mon.a (mon.0) 1214 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:05:29.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:29 smithi022 bash[26979]: audit 1689213929.3866222 mon.a (mon.0) 1215 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: cluster 1689213928.007665 mgr.a (mgr.14152) 1166 : cluster 0 pgmap v1042: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:29.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213928.5954938 mon.a (mon.0) 1207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213928.6086814 mon.a (mon.0) 1208 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.2279575 mon.a (mon.0) 1209 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.233635 mon.a (mon.0) 1210 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.2387047 mon.a (mon.0) 1211 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.2439137 mon.a (mon.0) 1212 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.3741949 mon.a (mon.0) 1213 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:05:29.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.375926 mon.a (mon.0) 1214 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:05:29.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:29 smithi154 bash[27744]: audit 1689213929.3866222 mon.a (mon.0) 1215 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: cluster 1689213928.007665 mgr.a (mgr.14152) 1166 : cluster 0 pgmap v1042: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213928.5954938 mon.a (mon.0) 1207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213928.6086814 mon.a (mon.0) 1208 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.2279575 mon.a (mon.0) 1209 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.233635 mon.a (mon.0) 1210 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.2387047 mon.a (mon.0) 1211 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.2439137 mon.a (mon.0) 1212 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.3741949 mon.a (mon.0) 1213 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:05:29.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.375926 mon.a (mon.0) 1214 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:05:29.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:29 smithi137 bash[27262]: audit 1689213929.3866222 mon.a (mon.0) 1215 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: cluster 1689213928.007665 mgr.a (mgr.14152) 1166 : cluster 0 pgmap v1042: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:29.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213928.5954938 mon.a (mon.0) 1207 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213928.6086814 mon.a (mon.0) 1208 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.2279575 mon.a (mon.0) 1209 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.233635 mon.a (mon.0) 1210 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.2387047 mon.a (mon.0) 1211 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.2439137 mon.a (mon.0) 1212 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:29.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.3741949 mon.a (mon.0) 1213 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:05:29.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.375926 mon.a (mon.0) 1214 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:05:29.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:29 smithi103 bash[27315]: audit 1689213929.3866222 mon.a (mon.0) 1215 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:05:30.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:30 smithi084 bash[27323]: cluster 1689213929.3787308 mgr.a (mgr.14152) 1167 : cluster 0 pgmap v1043: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:30 smithi084 bash[27323]: cluster 1689213929.3790708 mgr.a (mgr.14152) 1168 : cluster 0 pgmap v1044: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:30 smithi022 bash[26979]: cluster 1689213929.3787308 mgr.a (mgr.14152) 1167 : cluster 0 pgmap v1043: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:30 smithi022 bash[26979]: cluster 1689213929.3790708 mgr.a (mgr.14152) 1168 : cluster 0 pgmap v1044: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:30 smithi154 bash[27744]: cluster 1689213929.3787308 mgr.a (mgr.14152) 1167 : cluster 0 pgmap v1043: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:30 smithi154 bash[27744]: cluster 1689213929.3790708 mgr.a (mgr.14152) 1168 : cluster 0 pgmap v1044: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:30 smithi137 bash[27262]: cluster 1689213929.3787308 mgr.a (mgr.14152) 1167 : cluster 0 pgmap v1043: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:30 smithi137 bash[27262]: cluster 1689213929.3790708 mgr.a (mgr.14152) 1168 : cluster 0 pgmap v1044: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:30 smithi103 bash[27315]: cluster 1689213929.3787308 mgr.a (mgr.14152) 1167 : cluster 0 pgmap v1043: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:30.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:30 smithi103 bash[27315]: cluster 1689213929.3790708 mgr.a (mgr.14152) 1168 : cluster 0 pgmap v1044: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:31.889 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:05:32.648 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:32 smithi084 bash[27323]: cluster 1689213931.379599 mgr.a (mgr.14152) 1169 : cluster 0 pgmap v1045: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:32.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:32 smithi022 bash[26979]: cluster 1689213931.379599 mgr.a (mgr.14152) 1169 : cluster 0 pgmap v1045: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:32.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:32 smithi154 bash[27744]: cluster 1689213931.379599 mgr.a (mgr.14152) 1169 : cluster 0 pgmap v1045: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:32.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:32 smithi137 bash[27262]: cluster 1689213931.379599 mgr.a (mgr.14152) 1169 : cluster 0 pgmap v1045: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:32.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:32 smithi103 bash[27315]: cluster 1689213931.379599 mgr.a (mgr.14152) 1169 : cluster 0 pgmap v1045: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:34.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:34 smithi022 bash[26979]: cluster 1689213933.3801682 mgr.a (mgr.14152) 1170 : cluster 0 pgmap v1046: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:34.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:34 smithi154 bash[27744]: cluster 1689213933.3801682 mgr.a (mgr.14152) 1170 : cluster 0 pgmap v1046: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:34.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:34 smithi137 bash[27262]: cluster 1689213933.3801682 mgr.a (mgr.14152) 1170 : cluster 0 pgmap v1046: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:34.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:34 smithi103 bash[27315]: cluster 1689213933.3801682 mgr.a (mgr.14152) 1170 : cluster 0 pgmap v1046: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:34.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:34 smithi084 bash[27323]: cluster 1689213933.3801682 mgr.a (mgr.14152) 1170 : cluster 0 pgmap v1046: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:35.224 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:05:35.663 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:35 smithi022 bash[26979]: audit 1689213935.2270646 mon.b (mon.4) 34 : audit 0 from='client.? 172.21.15.22:0/3824345148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:35.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:35 smithi154 bash[27744]: audit 1689213935.2270646 mon.b (mon.4) 34 : audit 0 from='client.? 172.21.15.22:0/3824345148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:35.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:35 smithi137 bash[27262]: audit 1689213935.2270646 mon.b (mon.4) 34 : audit 0 from='client.? 172.21.15.22:0/3824345148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:35.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:35 smithi103 bash[27315]: audit 1689213935.2270646 mon.b (mon.4) 34 : audit 0 from='client.? 172.21.15.22:0/3824345148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:35.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:35 smithi084 bash[27323]: audit 1689213935.2270646 mon.b (mon.4) 34 : audit 0 from='client.? 172.21.15.22:0/3824345148' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:36.009 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:05:36.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:36 smithi022 bash[26979]: cluster 1689213935.3807266 mgr.a (mgr.14152) 1171 : cluster 0 pgmap v1047: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:36.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:36 smithi154 bash[27744]: cluster 1689213935.3807266 mgr.a (mgr.14152) 1171 : cluster 0 pgmap v1047: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:36.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:36 smithi137 bash[27262]: cluster 1689213935.3807266 mgr.a (mgr.14152) 1171 : cluster 0 pgmap v1047: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:36.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:36 smithi103 bash[27315]: cluster 1689213935.3807266 mgr.a (mgr.14152) 1171 : cluster 0 pgmap v1047: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:36.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:36 smithi084 bash[27323]: cluster 1689213935.3807266 mgr.a (mgr.14152) 1171 : cluster 0 pgmap v1047: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:37.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:05:38.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:38 smithi022 bash[26979]: cluster 1689213937.381254 mgr.a (mgr.14152) 1172 : cluster 0 pgmap v1048: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:38.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:38 smithi154 bash[27744]: cluster 1689213937.381254 mgr.a (mgr.14152) 1172 : cluster 0 pgmap v1048: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:38.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:38 smithi137 bash[27262]: cluster 1689213937.381254 mgr.a (mgr.14152) 1172 : cluster 0 pgmap v1048: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:38.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:38 smithi103 bash[27315]: cluster 1689213937.381254 mgr.a (mgr.14152) 1172 : cluster 0 pgmap v1048: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:38.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:38 smithi084 bash[27323]: cluster 1689213937.381254 mgr.a (mgr.14152) 1172 : cluster 0 pgmap v1048: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:40.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:40 smithi022 bash[26979]: cluster 1689213939.3817525 mgr.a (mgr.14152) 1173 : cluster 0 pgmap v1049: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:40.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:40 smithi154 bash[27744]: cluster 1689213939.3817525 mgr.a (mgr.14152) 1173 : cluster 0 pgmap v1049: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:40.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:40 smithi137 bash[27262]: cluster 1689213939.3817525 mgr.a (mgr.14152) 1173 : cluster 0 pgmap v1049: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:40.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:40 smithi103 bash[27315]: cluster 1689213939.3817525 mgr.a (mgr.14152) 1173 : cluster 0 pgmap v1049: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:40.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:40 smithi084 bash[27323]: cluster 1689213939.3817525 mgr.a (mgr.14152) 1173 : cluster 0 pgmap v1049: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:41.710 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:05:42.734 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:42 smithi022 bash[26979]: cluster 1689213941.38228 mgr.a (mgr.14152) 1174 : cluster 0 pgmap v1050: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:42.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:42 smithi154 bash[27744]: cluster 1689213941.38228 mgr.a (mgr.14152) 1174 : cluster 0 pgmap v1050: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:42.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:42 smithi137 bash[27262]: cluster 1689213941.38228 mgr.a (mgr.14152) 1174 : cluster 0 pgmap v1050: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:42.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:42 smithi103 bash[27315]: cluster 1689213941.38228 mgr.a (mgr.14152) 1174 : cluster 0 pgmap v1050: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:42.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:42 smithi084 bash[27323]: cluster 1689213941.38228 mgr.a (mgr.14152) 1174 : cluster 0 pgmap v1050: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:44.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:44 smithi022 bash[26979]: cluster 1689213943.3828013 mgr.a (mgr.14152) 1175 : cluster 0 pgmap v1051: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:44.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:44 smithi154 bash[27744]: cluster 1689213943.3828013 mgr.a (mgr.14152) 1175 : cluster 0 pgmap v1051: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:44.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:44 smithi137 bash[27262]: cluster 1689213943.3828013 mgr.a (mgr.14152) 1175 : cluster 0 pgmap v1051: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:44.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:44 smithi103 bash[27315]: cluster 1689213943.3828013 mgr.a (mgr.14152) 1175 : cluster 0 pgmap v1051: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:44.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:44 smithi084 bash[27323]: cluster 1689213943.3828013 mgr.a (mgr.14152) 1175 : cluster 0 pgmap v1051: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:45.085 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:05:45.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:45 smithi022 bash[26979]: audit 1689213945.0884564 mon.c (mon.2) 24 : audit 0 from='client.? 172.21.15.22:0/162815946' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:45.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:45 smithi154 bash[27744]: audit 1689213945.0884564 mon.c (mon.2) 24 : audit 0 from='client.? 172.21.15.22:0/162815946' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:45.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:45 smithi137 bash[27262]: audit 1689213945.0884564 mon.c (mon.2) 24 : audit 0 from='client.? 172.21.15.22:0/162815946' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:45.821 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:05:45.859 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:45 smithi103 bash[27315]: audit 1689213945.0884564 mon.c (mon.2) 24 : audit 0 from='client.? 172.21.15.22:0/162815946' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:45.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:45 smithi084 bash[27323]: audit 1689213945.0884564 mon.c (mon.2) 24 : audit 0 from='client.? 172.21.15.22:0/162815946' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:46.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:46 smithi154 bash[27744]: cluster 1689213945.3831615 mgr.a (mgr.14152) 1176 : cluster 0 pgmap v1052: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:46.809 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:46 smithi137 bash[27262]: cluster 1689213945.3831615 mgr.a (mgr.14152) 1176 : cluster 0 pgmap v1052: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:46.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:05:46.836 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:46 smithi022 bash[26979]: cluster 1689213945.3831615 mgr.a (mgr.14152) 1176 : cluster 0 pgmap v1052: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:46.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:46 smithi103 bash[27315]: cluster 1689213945.3831615 mgr.a (mgr.14152) 1176 : cluster 0 pgmap v1052: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:46.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:46 smithi084 bash[27323]: cluster 1689213945.3831615 mgr.a (mgr.14152) 1176 : cluster 0 pgmap v1052: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:48.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:48 smithi154 bash[27744]: cluster 1689213947.3836415 mgr.a (mgr.14152) 1177 : cluster 0 pgmap v1053: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:48.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:48 smithi137 bash[27262]: cluster 1689213947.3836415 mgr.a (mgr.14152) 1177 : cluster 0 pgmap v1053: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:48.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:48 smithi103 bash[27315]: cluster 1689213947.3836415 mgr.a (mgr.14152) 1177 : cluster 0 pgmap v1053: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:48.898 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:48 smithi084 bash[27323]: cluster 1689213947.3836415 mgr.a (mgr.14152) 1177 : cluster 0 pgmap v1053: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:48.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:48 smithi022 bash[26979]: cluster 1689213947.3836415 mgr.a (mgr.14152) 1177 : cluster 0 pgmap v1053: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:50.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:50 smithi154 bash[27744]: cluster 1689213949.3841884 mgr.a (mgr.14152) 1178 : cluster 0 pgmap v1054: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:50.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:50 smithi137 bash[27262]: cluster 1689213949.3841884 mgr.a (mgr.14152) 1178 : cluster 0 pgmap v1054: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:50.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:50 smithi103 bash[27315]: cluster 1689213949.3841884 mgr.a (mgr.14152) 1178 : cluster 0 pgmap v1054: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:50.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:50 smithi084 bash[27323]: cluster 1689213949.3841884 mgr.a (mgr.14152) 1178 : cluster 0 pgmap v1054: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:50.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:50 smithi022 bash[26979]: cluster 1689213949.3841884 mgr.a (mgr.14152) 1178 : cluster 0 pgmap v1054: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:51.527 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:05:52.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:52 smithi154 bash[27744]: cluster 1689213951.384706 mgr.a (mgr.14152) 1179 : cluster 0 pgmap v1055: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:52.768 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:52 smithi022 bash[26979]: cluster 1689213951.384706 mgr.a (mgr.14152) 1179 : cluster 0 pgmap v1055: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:52.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:52 smithi137 bash[27262]: cluster 1689213951.384706 mgr.a (mgr.14152) 1179 : cluster 0 pgmap v1055: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:52.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:52 smithi103 bash[27315]: cluster 1689213951.384706 mgr.a (mgr.14152) 1179 : cluster 0 pgmap v1055: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:52.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:52 smithi084 bash[27323]: cluster 1689213951.384706 mgr.a (mgr.14152) 1179 : cluster 0 pgmap v1055: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:54.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:54 smithi022 bash[26979]: cluster 1689213953.3852124 mgr.a (mgr.14152) 1180 : cluster 0 pgmap v1056: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:54.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:54 smithi154 bash[27744]: cluster 1689213953.3852124 mgr.a (mgr.14152) 1180 : cluster 0 pgmap v1056: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:54.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:54 smithi137 bash[27262]: cluster 1689213953.3852124 mgr.a (mgr.14152) 1180 : cluster 0 pgmap v1056: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:54.841 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:05:54.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:54 smithi103 bash[27315]: cluster 1689213953.3852124 mgr.a (mgr.14152) 1180 : cluster 0 pgmap v1056: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:54.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:54 smithi084 bash[27323]: cluster 1689213953.3852124 mgr.a (mgr.14152) 1180 : cluster 0 pgmap v1056: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:55.574 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:05:55.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:55 smithi154 bash[27744]: audit 1689213954.8419669 mon.a (mon.0) 1216 : audit 0 from='client.? 172.21.15.22:0/2180950992' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:55.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:55 smithi137 bash[27262]: audit 1689213954.8419669 mon.a (mon.0) 1216 : audit 0 from='client.? 172.21.15.22:0/2180950992' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:55.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:55 smithi103 bash[27315]: audit 1689213954.8419669 mon.a (mon.0) 1216 : audit 0 from='client.? 172.21.15.22:0/2180950992' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:55.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:55 smithi084 bash[27323]: audit 1689213954.8419669 mon.a (mon.0) 1216 : audit 0 from='client.? 172.21.15.22:0/2180950992' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:55.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:55 smithi022 bash[26979]: audit 1689213954.8419669 mon.a (mon.0) 1216 : audit 0 from='client.? 172.21.15.22:0/2180950992' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:05:56.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:05:56.763 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:56 smithi154 bash[27744]: cluster 1689213955.3856995 mgr.a (mgr.14152) 1181 : cluster 0 pgmap v1057: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:56.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:56 smithi137 bash[27262]: cluster 1689213955.3856995 mgr.a (mgr.14152) 1181 : cluster 0 pgmap v1057: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:56.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:56 smithi103 bash[27315]: cluster 1689213955.3856995 mgr.a (mgr.14152) 1181 : cluster 0 pgmap v1057: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:56.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:56 smithi084 bash[27323]: cluster 1689213955.3856995 mgr.a (mgr.14152) 1181 : cluster 0 pgmap v1057: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:56.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:56 smithi022 bash[26979]: cluster 1689213955.3856995 mgr.a (mgr.14152) 1181 : cluster 0 pgmap v1057: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:58.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:05:58 smithi154 bash[27744]: cluster 1689213957.3862302 mgr.a (mgr.14152) 1182 : cluster 0 pgmap v1058: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:58.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:05:58 smithi137 bash[27262]: cluster 1689213957.3862302 mgr.a (mgr.14152) 1182 : cluster 0 pgmap v1058: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:58.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:05:58 smithi103 bash[27315]: cluster 1689213957.3862302 mgr.a (mgr.14152) 1182 : cluster 0 pgmap v1058: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:58.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:05:58 smithi084 bash[27323]: cluster 1689213957.3862302 mgr.a (mgr.14152) 1182 : cluster 0 pgmap v1058: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:05:58.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:05:58 smithi022 bash[26979]: cluster 1689213957.3862302 mgr.a (mgr.14152) 1182 : cluster 0 pgmap v1058: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:00.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:00 smithi154 bash[27744]: cluster 1689213959.3867292 mgr.a (mgr.14152) 1183 : cluster 0 pgmap v1059: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:00.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:00 smithi137 bash[27262]: cluster 1689213959.3867292 mgr.a (mgr.14152) 1183 : cluster 0 pgmap v1059: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:00.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:00 smithi103 bash[27315]: cluster 1689213959.3867292 mgr.a (mgr.14152) 1183 : cluster 0 pgmap v1059: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:00.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:00 smithi084 bash[27323]: cluster 1689213959.3867292 mgr.a (mgr.14152) 1183 : cluster 0 pgmap v1059: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:00.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:00 smithi022 bash[26979]: cluster 1689213959.3867292 mgr.a (mgr.14152) 1183 : cluster 0 pgmap v1059: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:06:02.570 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:02 smithi022 bash[26979]: cluster 1689213961.3872287 mgr.a (mgr.14152) 1184 : cluster 0 pgmap v1060: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:02.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:02 smithi154 bash[27744]: cluster 1689213961.3872287 mgr.a (mgr.14152) 1184 : cluster 0 pgmap v1060: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:02.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:02 smithi137 bash[27262]: cluster 1689213961.3872287 mgr.a (mgr.14152) 1184 : cluster 0 pgmap v1060: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:02.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:02 smithi103 bash[27315]: cluster 1689213961.3872287 mgr.a (mgr.14152) 1184 : cluster 0 pgmap v1060: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:02.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:02 smithi084 bash[27323]: cluster 1689213961.3872287 mgr.a (mgr.14152) 1184 : cluster 0 pgmap v1060: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:04.470 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:06:04.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:04 smithi154 bash[27744]: cluster 1689213963.387643 mgr.a (mgr.14152) 1185 : cluster 0 pgmap v1061: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:04.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:04 smithi137 bash[27262]: cluster 1689213963.387643 mgr.a (mgr.14152) 1185 : cluster 0 pgmap v1061: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:04.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:04 smithi103 bash[27315]: cluster 1689213963.387643 mgr.a (mgr.14152) 1185 : cluster 0 pgmap v1061: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:04.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:04 smithi084 bash[27323]: cluster 1689213963.387643 mgr.a (mgr.14152) 1185 : cluster 0 pgmap v1061: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:04.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:04 smithi022 bash[26979]: cluster 1689213963.387643 mgr.a (mgr.14152) 1185 : cluster 0 pgmap v1061: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:05.249 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:06:05.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:05 smithi022 bash[26979]: audit 1689213964.4745169 mon.e (mon.1) 24 : audit 0 from='client.? 172.21.15.22:0/1722474120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:05.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:05 smithi154 bash[27744]: audit 1689213964.4745169 mon.e (mon.1) 24 : audit 0 from='client.? 172.21.15.22:0/1722474120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:05.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:05 smithi137 bash[27262]: audit 1689213964.4745169 mon.e (mon.1) 24 : audit 0 from='client.? 172.21.15.22:0/1722474120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:05.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:05 smithi103 bash[27315]: audit 1689213964.4745169 mon.e (mon.1) 24 : audit 0 from='client.? 172.21.15.22:0/1722474120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:05.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:05 smithi084 bash[27323]: audit 1689213964.4745169 mon.e (mon.1) 24 : audit 0 from='client.? 172.21.15.22:0/1722474120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:06.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:06:06.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:06 smithi022 bash[26979]: cluster 1689213965.3881876 mgr.a (mgr.14152) 1186 : cluster 0 pgmap v1062: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:06.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:06 smithi154 bash[27744]: cluster 1689213965.3881876 mgr.a (mgr.14152) 1186 : cluster 0 pgmap v1062: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:06.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:06 smithi137 bash[27262]: cluster 1689213965.3881876 mgr.a (mgr.14152) 1186 : cluster 0 pgmap v1062: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:06.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:06 smithi103 bash[27315]: cluster 1689213965.3881876 mgr.a (mgr.14152) 1186 : cluster 0 pgmap v1062: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:06.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:06 smithi084 bash[27323]: cluster 1689213965.3881876 mgr.a (mgr.14152) 1186 : cluster 0 pgmap v1062: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:08.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:08 smithi154 bash[27744]: cluster 1689213967.3886745 mgr.a (mgr.14152) 1187 : cluster 0 pgmap v1063: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:08.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:08 smithi137 bash[27262]: cluster 1689213967.3886745 mgr.a (mgr.14152) 1187 : cluster 0 pgmap v1063: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:08.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:08 smithi103 bash[27315]: cluster 1689213967.3886745 mgr.a (mgr.14152) 1187 : cluster 0 pgmap v1063: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:08.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:08 smithi084 bash[27323]: cluster 1689213967.3886745 mgr.a (mgr.14152) 1187 : cluster 0 pgmap v1063: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:08.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:08 smithi022 bash[26979]: cluster 1689213967.3886745 mgr.a (mgr.14152) 1187 : cluster 0 pgmap v1063: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:10.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:10 smithi154 bash[27744]: cluster 1689213969.389208 mgr.a (mgr.14152) 1188 : cluster 0 pgmap v1064: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:10.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:10 smithi137 bash[27262]: cluster 1689213969.389208 mgr.a (mgr.14152) 1188 : cluster 0 pgmap v1064: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:10.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:10 smithi103 bash[27315]: cluster 1689213969.389208 mgr.a (mgr.14152) 1188 : cluster 0 pgmap v1064: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:10.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:10 smithi084 bash[27323]: cluster 1689213969.389208 mgr.a (mgr.14152) 1188 : cluster 0 pgmap v1064: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:10.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:10 smithi022 bash[26979]: cluster 1689213969.389208 mgr.a (mgr.14152) 1188 : cluster 0 pgmap v1064: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:10.946 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:06:11.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:11 smithi137 bash[27262]: cluster 1689213971.3898058 mgr.a (mgr.14152) 1189 : cluster 0 pgmap v1065: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:11.860 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:11 smithi103 bash[27315]: cluster 1689213971.3898058 mgr.a (mgr.14152) 1189 : cluster 0 pgmap v1065: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:11.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:11 smithi084 bash[27323]: cluster 1689213971.3898058 mgr.a (mgr.14152) 1189 : cluster 0 pgmap v1065: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:11.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:11 smithi022 bash[26979]: cluster 1689213971.3898058 mgr.a (mgr.14152) 1189 : cluster 0 pgmap v1065: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:12.014 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:11 smithi154 bash[27744]: cluster 1689213971.3898058 mgr.a (mgr.14152) 1189 : cluster 0 pgmap v1065: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:14.333 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:06:14.664 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:14 smithi022 bash[26979]: cluster 1689213973.3903537 mgr.a (mgr.14152) 1190 : cluster 0 pgmap v1066: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:14.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:14 smithi022 bash[26979]: audit 1689213974.3342037 mon.a (mon.0) 1217 : audit 0 from='client.? 172.21.15.22:0/2298244930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:14.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:14 smithi154 bash[27744]: cluster 1689213973.3903537 mgr.a (mgr.14152) 1190 : cluster 0 pgmap v1066: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:14.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:14 smithi154 bash[27744]: audit 1689213974.3342037 mon.a (mon.0) 1217 : audit 0 from='client.? 172.21.15.22:0/2298244930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:14.810 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:14 smithi137 bash[27262]: cluster 1689213973.3903537 mgr.a (mgr.14152) 1190 : cluster 0 pgmap v1066: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:14.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:14 smithi137 bash[27262]: audit 1689213974.3342037 mon.a (mon.0) 1217 : audit 0 from='client.? 172.21.15.22:0/2298244930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:14.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:14 smithi103 bash[27315]: cluster 1689213973.3903537 mgr.a (mgr.14152) 1190 : cluster 0 pgmap v1066: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:14.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:14 smithi103 bash[27315]: audit 1689213974.3342037 mon.a (mon.0) 1217 : audit 0 from='client.? 172.21.15.22:0/2298244930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:14.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:14 smithi084 bash[27323]: cluster 1689213973.3903537 mgr.a (mgr.14152) 1190 : cluster 0 pgmap v1066: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:14.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:14 smithi084 bash[27323]: audit 1689213974.3342037 mon.a (mon.0) 1217 : audit 0 from='client.? 172.21.15.22:0/2298244930' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:15.067 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:06:16.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:06:16.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:16 smithi022 bash[26979]: cluster 1689213975.390842 mgr.a (mgr.14152) 1191 : cluster 0 pgmap v1067: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:16.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:16 smithi137 bash[27262]: cluster 1689213975.390842 mgr.a (mgr.14152) 1191 : cluster 0 pgmap v1067: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:16.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:16 smithi103 bash[27315]: cluster 1689213975.390842 mgr.a (mgr.14152) 1191 : cluster 0 pgmap v1067: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:16.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:16 smithi084 bash[27323]: cluster 1689213975.390842 mgr.a (mgr.14152) 1191 : cluster 0 pgmap v1067: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:16.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:16 smithi154 bash[27744]: cluster 1689213975.390842 mgr.a (mgr.14152) 1191 : cluster 0 pgmap v1067: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:18.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:18 smithi154 bash[27744]: cluster 1689213977.3915339 mgr.a (mgr.14152) 1192 : cluster 0 pgmap v1068: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:18.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:18 smithi137 bash[27262]: cluster 1689213977.3915339 mgr.a (mgr.14152) 1192 : cluster 0 pgmap v1068: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:18.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:18 smithi103 bash[27315]: cluster 1689213977.3915339 mgr.a (mgr.14152) 1192 : cluster 0 pgmap v1068: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:18.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:18 smithi084 bash[27323]: cluster 1689213977.3915339 mgr.a (mgr.14152) 1192 : cluster 0 pgmap v1068: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:18.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:18 smithi022 bash[26979]: cluster 1689213977.3915339 mgr.a (mgr.14152) 1192 : cluster 0 pgmap v1068: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:20.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:20 smithi154 bash[27744]: cluster 1689213979.3922215 mgr.a (mgr.14152) 1193 : cluster 0 pgmap v1069: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:20.768 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:06:20.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:20 smithi022 bash[26979]: cluster 1689213979.3922215 mgr.a (mgr.14152) 1193 : cluster 0 pgmap v1069: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:20.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:20 smithi137 bash[27262]: cluster 1689213979.3922215 mgr.a (mgr.14152) 1193 : cluster 0 pgmap v1069: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:20.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:20 smithi103 bash[27315]: cluster 1689213979.3922215 mgr.a (mgr.14152) 1193 : cluster 0 pgmap v1069: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:20.899 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:20 smithi084 bash[27323]: cluster 1689213979.3922215 mgr.a (mgr.14152) 1193 : cluster 0 pgmap v1069: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:22.737 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:22 smithi022 bash[26979]: cluster 1689213981.3927913 mgr.a (mgr.14152) 1194 : cluster 0 pgmap v1070: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:22.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:22 smithi154 bash[27744]: cluster 1689213981.3927913 mgr.a (mgr.14152) 1194 : cluster 0 pgmap v1070: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:22.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:22 smithi137 bash[27262]: cluster 1689213981.3927913 mgr.a (mgr.14152) 1194 : cluster 0 pgmap v1070: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:22.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:22 smithi103 bash[27315]: cluster 1689213981.3927913 mgr.a (mgr.14152) 1194 : cluster 0 pgmap v1070: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:22.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:22 smithi084 bash[27323]: cluster 1689213981.3927913 mgr.a (mgr.14152) 1194 : cluster 0 pgmap v1070: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:24.132 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:06:24.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:24 smithi022 bash[26979]: cluster 1689213983.3933077 mgr.a (mgr.14152) 1195 : cluster 0 pgmap v1071: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:24.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:24 smithi022 bash[26979]: audit 1689213984.1330132 mon.d (mon.3) 19 : audit 0 from='client.? 172.21.15.22:0/2567818882' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:24.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:24 smithi154 bash[27744]: cluster 1689213983.3933077 mgr.a (mgr.14152) 1195 : cluster 0 pgmap v1071: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:24.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:24 smithi154 bash[27744]: audit 1689213984.1330132 mon.d (mon.3) 19 : audit 0 from='client.? 172.21.15.22:0/2567818882' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:24.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:24 smithi137 bash[27262]: cluster 1689213983.3933077 mgr.a (mgr.14152) 1195 : cluster 0 pgmap v1071: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:24.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:24 smithi137 bash[27262]: audit 1689213984.1330132 mon.d (mon.3) 19 : audit 0 from='client.? 172.21.15.22:0/2567818882' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:24.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:24 smithi103 bash[27315]: cluster 1689213983.3933077 mgr.a (mgr.14152) 1195 : cluster 0 pgmap v1071: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:24.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:24 smithi103 bash[27315]: audit 1689213984.1330132 mon.d (mon.3) 19 : audit 0 from='client.? 172.21.15.22:0/2567818882' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:24.869 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:06:24.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:24 smithi084 bash[27323]: cluster 1689213983.3933077 mgr.a (mgr.14152) 1195 : cluster 0 pgmap v1071: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:24.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:24 smithi084 bash[27323]: audit 1689213984.1330132 mon.d (mon.3) 19 : audit 0 from='client.? 172.21.15.22:0/2567818882' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:25.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:06:26.561 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:26 smithi137 bash[27262]: cluster 1689213985.3938792 mgr.a (mgr.14152) 1196 : cluster 0 pgmap v1072: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:26.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:26 smithi103 bash[27315]: cluster 1689213985.3938792 mgr.a (mgr.14152) 1196 : cluster 0 pgmap v1072: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:26.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:26 smithi084 bash[27323]: cluster 1689213985.3938792 mgr.a (mgr.14152) 1196 : cluster 0 pgmap v1072: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:26.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:26 smithi022 bash[26979]: cluster 1689213985.3938792 mgr.a (mgr.14152) 1196 : cluster 0 pgmap v1072: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:26.764 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:26 smithi154 bash[27744]: cluster 1689213985.3938792 mgr.a (mgr.14152) 1196 : cluster 0 pgmap v1072: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:28.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:28 smithi154 bash[27744]: cluster 1689213987.3944123 mgr.a (mgr.14152) 1197 : cluster 0 pgmap v1073: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:28.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:28 smithi137 bash[27262]: cluster 1689213987.3944123 mgr.a (mgr.14152) 1197 : cluster 0 pgmap v1073: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:28.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:28 smithi103 bash[27315]: cluster 1689213987.3944123 mgr.a (mgr.14152) 1197 : cluster 0 pgmap v1073: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:28.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:28 smithi084 bash[27323]: cluster 1689213987.3944123 mgr.a (mgr.14152) 1197 : cluster 0 pgmap v1073: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:28.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:28 smithi022 bash[26979]: cluster 1689213987.3944123 mgr.a (mgr.14152) 1197 : cluster 0 pgmap v1073: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:30.570 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:06:30.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: cluster 1689213989.3950062 mgr.a (mgr.14152) 1198 : cluster 0 pgmap v1074: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:30.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213989.5548189 mon.a (mon.0) 1218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:06:30.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213989.9854908 mon.a (mon.0) 1219 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213989.9926353 mon.a (mon.0) 1220 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213989.9983392 mon.a (mon.0) 1221 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213990.006494 mon.a (mon.0) 1222 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213990.012232 mon.a (mon.0) 1223 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:30 smithi154 bash[27744]: audit 1689213990.0173218 mon.a (mon.0) 1224 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: cluster 1689213989.3950062 mgr.a (mgr.14152) 1198 : cluster 0 pgmap v1074: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213989.5548189 mon.a (mon.0) 1218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213989.9854908 mon.a (mon.0) 1219 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213989.9926353 mon.a (mon.0) 1220 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213989.9983392 mon.a (mon.0) 1221 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213990.006494 mon.a (mon.0) 1222 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213990.012232 mon.a (mon.0) 1223 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:30 smithi137 bash[27262]: audit 1689213990.0173218 mon.a (mon.0) 1224 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: cluster 1689213989.3950062 mgr.a (mgr.14152) 1198 : cluster 0 pgmap v1074: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:30.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213989.5548189 mon.a (mon.0) 1218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:06:30.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213989.9854908 mon.a (mon.0) 1219 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213989.9926353 mon.a (mon.0) 1220 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213989.9983392 mon.a (mon.0) 1221 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213990.006494 mon.a (mon.0) 1222 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213990.012232 mon.a (mon.0) 1223 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:30 smithi103 bash[27315]: audit 1689213990.0173218 mon.a (mon.0) 1224 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: cluster 1689213989.3950062 mgr.a (mgr.14152) 1198 : cluster 0 pgmap v1074: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:30.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213989.5548189 mon.a (mon.0) 1218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:06:30.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213989.9854908 mon.a (mon.0) 1219 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213989.9926353 mon.a (mon.0) 1220 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213989.9983392 mon.a (mon.0) 1221 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213990.006494 mon.a (mon.0) 1222 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213990.012232 mon.a (mon.0) 1223 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:30 smithi084 bash[27323]: audit 1689213990.0173218 mon.a (mon.0) 1224 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: cluster 1689213989.3950062 mgr.a (mgr.14152) 1198 : cluster 0 pgmap v1074: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:30.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213989.5548189 mon.a (mon.0) 1218 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:06:30.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213989.9854908 mon.a (mon.0) 1219 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213989.9926353 mon.a (mon.0) 1220 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213989.9983392 mon.a (mon.0) 1221 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213990.006494 mon.a (mon.0) 1222 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213990.012232 mon.a (mon.0) 1223 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:30.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:30 smithi022 bash[26979]: audit 1689213990.0173218 mon.a (mon.0) 1224 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:32.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:32 smithi154 bash[27744]: cluster 1689213991.395508 mgr.a (mgr.14152) 1199 : cluster 0 pgmap v1075: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:32.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:32 smithi137 bash[27262]: cluster 1689213991.395508 mgr.a (mgr.14152) 1199 : cluster 0 pgmap v1075: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:32.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:32 smithi103 bash[27315]: cluster 1689213991.395508 mgr.a (mgr.14152) 1199 : cluster 0 pgmap v1075: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:32.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:32 smithi084 bash[27323]: cluster 1689213991.395508 mgr.a (mgr.14152) 1199 : cluster 0 pgmap v1075: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:32.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:32 smithi022 bash[26979]: cluster 1689213991.395508 mgr.a (mgr.14152) 1199 : cluster 0 pgmap v1075: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:33.866 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:06:34.644 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:06:34.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:34 smithi154 bash[27744]: cluster 1689213993.396148 mgr.a (mgr.14152) 1200 : cluster 0 pgmap v1076: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:34.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:34 smithi154 bash[27744]: audit 1689213993.8658588 mon.a (mon.0) 1225 : audit 0 from='client.? 172.21.15.22:0/2193555940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:34.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:34 smithi137 bash[27262]: cluster 1689213993.396148 mgr.a (mgr.14152) 1200 : cluster 0 pgmap v1076: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:34.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:34 smithi137 bash[27262]: audit 1689213993.8658588 mon.a (mon.0) 1225 : audit 0 from='client.? 172.21.15.22:0/2193555940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:34.861 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:34 smithi103 bash[27315]: cluster 1689213993.396148 mgr.a (mgr.14152) 1200 : cluster 0 pgmap v1076: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:34.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:34 smithi103 bash[27315]: audit 1689213993.8658588 mon.a (mon.0) 1225 : audit 0 from='client.? 172.21.15.22:0/2193555940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:34 smithi084 bash[27323]: cluster 1689213993.396148 mgr.a (mgr.14152) 1200 : cluster 0 pgmap v1076: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:34.900 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:34 smithi084 bash[27323]: audit 1689213993.8658588 mon.a (mon.0) 1225 : audit 0 from='client.? 172.21.15.22:0/2193555940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:34.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:34 smithi022 bash[26979]: cluster 1689213993.396148 mgr.a (mgr.14152) 1200 : cluster 0 pgmap v1076: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:34.915 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:34 smithi022 bash[26979]: audit 1689213993.8658588 mon.a (mon.0) 1225 : audit 0 from='client.? 172.21.15.22:0/2193555940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:35.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:06:36.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: cluster 1689213995.3967383 mgr.a (mgr.14152) 1201 : cluster 0 pgmap v1077: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:36.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213995.6882794 mon.a (mon.0) 1226 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213995.6964586 mon.a (mon.0) 1227 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213996.1907456 mon.a (mon.0) 1228 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213996.192553 mon.a (mon.0) 1229 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213996.1940076 mon.a (mon.0) 1230 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213996.19733 mon.a (mon.0) 1231 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:06:36.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213996.1988287 mon.a (mon.0) 1232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:06:36.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:36 smithi103 bash[27315]: audit 1689213996.2090433 mon.a (mon.0) 1233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: cluster 1689213995.3967383 mgr.a (mgr.14152) 1201 : cluster 0 pgmap v1077: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:36.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213995.6882794 mon.a (mon.0) 1226 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213995.6964586 mon.a (mon.0) 1227 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213996.1907456 mon.a (mon.0) 1228 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213996.192553 mon.a (mon.0) 1229 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213996.1940076 mon.a (mon.0) 1230 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213996.19733 mon.a (mon.0) 1231 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:06:36.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213996.1988287 mon.a (mon.0) 1232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:06:36.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:36 smithi084 bash[27323]: audit 1689213996.2090433 mon.a (mon.0) 1233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: cluster 1689213995.3967383 mgr.a (mgr.14152) 1201 : cluster 0 pgmap v1077: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213995.6882794 mon.a (mon.0) 1226 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213995.6964586 mon.a (mon.0) 1227 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213996.1907456 mon.a (mon.0) 1228 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213996.192553 mon.a (mon.0) 1229 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213996.1940076 mon.a (mon.0) 1230 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213996.19733 mon.a (mon.0) 1231 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213996.1988287 mon.a (mon.0) 1232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:06:36.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:36 smithi022 bash[26979]: audit 1689213996.2090433 mon.a (mon.0) 1233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: cluster 1689213995.3967383 mgr.a (mgr.14152) 1201 : cluster 0 pgmap v1077: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:36.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213995.6882794 mon.a (mon.0) 1226 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213995.6964586 mon.a (mon.0) 1227 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213996.1907456 mon.a (mon.0) 1228 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213996.192553 mon.a (mon.0) 1229 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213996.1940076 mon.a (mon.0) 1230 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213996.19733 mon.a (mon.0) 1231 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:06:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213996.1988287 mon.a (mon.0) 1232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:06:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:36 smithi154 bash[27744]: audit 1689213996.2090433 mon.a (mon.0) 1233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: cluster 1689213995.3967383 mgr.a (mgr.14152) 1201 : cluster 0 pgmap v1077: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:36.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213995.6882794 mon.a (mon.0) 1226 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213995.6964586 mon.a (mon.0) 1227 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:36.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213996.1907456 mon.a (mon.0) 1228 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213996.192553 mon.a (mon.0) 1229 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213996.1940076 mon.a (mon.0) 1230 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:06:36.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213996.19733 mon.a (mon.0) 1231 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:06:36.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213996.1988287 mon.a (mon.0) 1232 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:06:36.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:36 smithi137 bash[27262]: audit 1689213996.2090433 mon.a (mon.0) 1233 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:06:37.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:37 smithi103 bash[27315]: cephadm 1689213996.1952157 mgr.a (mgr.14152) 1202 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T02:06:37.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:37 smithi103 bash[27315]: cluster 1689213996.2014856 mgr.a (mgr.14152) 1203 : cluster 0 pgmap v1078: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:37 smithi103 bash[27315]: cluster 1689213996.2017994 mgr.a (mgr.14152) 1204 : cluster 0 pgmap v1079: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:37 smithi084 bash[27323]: cephadm 1689213996.1952157 mgr.a (mgr.14152) 1202 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T02:06:37.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:37 smithi084 bash[27323]: cluster 1689213996.2014856 mgr.a (mgr.14152) 1203 : cluster 0 pgmap v1078: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:37 smithi084 bash[27323]: cluster 1689213996.2017994 mgr.a (mgr.14152) 1204 : cluster 0 pgmap v1079: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:37 smithi022 bash[26979]: cephadm 1689213996.1952157 mgr.a (mgr.14152) 1202 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T02:06:37.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:37 smithi022 bash[26979]: cluster 1689213996.2014856 mgr.a (mgr.14152) 1203 : cluster 0 pgmap v1078: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:37 smithi022 bash[26979]: cluster 1689213996.2017994 mgr.a (mgr.14152) 1204 : cluster 0 pgmap v1079: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:37 smithi154 bash[27744]: cephadm 1689213996.1952157 mgr.a (mgr.14152) 1202 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T02:06:37.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:37 smithi154 bash[27744]: cluster 1689213996.2014856 mgr.a (mgr.14152) 1203 : cluster 0 pgmap v1078: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:37 smithi154 bash[27744]: cluster 1689213996.2017994 mgr.a (mgr.14152) 1204 : cluster 0 pgmap v1079: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:37 smithi137 bash[27262]: cephadm 1689213996.1952157 mgr.a (mgr.14152) 1202 : cephadm 1 Adjusting osd_memory_target on smithi103 to 5755M 2023-07-13T02:06:37.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:37 smithi137 bash[27262]: cluster 1689213996.2014856 mgr.a (mgr.14152) 1203 : cluster 0 pgmap v1078: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:37.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:37 smithi137 bash[27262]: cluster 1689213996.2017994 mgr.a (mgr.14152) 1204 : cluster 0 pgmap v1079: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:39.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:39 smithi103 bash[27315]: cluster 1689213998.2023325 mgr.a (mgr.14152) 1205 : cluster 0 pgmap v1080: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:39.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:39 smithi084 bash[27323]: cluster 1689213998.2023325 mgr.a (mgr.14152) 1205 : cluster 0 pgmap v1080: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:39.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:39 smithi022 bash[26979]: cluster 1689213998.2023325 mgr.a (mgr.14152) 1205 : cluster 0 pgmap v1080: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:39.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:39 smithi154 bash[27744]: cluster 1689213998.2023325 mgr.a (mgr.14152) 1205 : cluster 0 pgmap v1080: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:39.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:39 smithi137 bash[27262]: cluster 1689213998.2023325 mgr.a (mgr.14152) 1205 : cluster 0 pgmap v1080: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:40.347 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:06:41.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:41 smithi022 bash[26979]: cluster 1689214000.202869 mgr.a (mgr.14152) 1206 : cluster 0 pgmap v1081: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:41.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:41 smithi103 bash[27315]: cluster 1689214000.202869 mgr.a (mgr.14152) 1206 : cluster 0 pgmap v1081: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:41.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:41 smithi084 bash[27323]: cluster 1689214000.202869 mgr.a (mgr.14152) 1206 : cluster 0 pgmap v1081: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:41.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:41 smithi154 bash[27744]: cluster 1689214000.202869 mgr.a (mgr.14152) 1206 : cluster 0 pgmap v1081: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:41.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:41 smithi137 bash[27262]: cluster 1689214000.202869 mgr.a (mgr.14152) 1206 : cluster 0 pgmap v1081: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:43.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:43 smithi022 bash[26979]: cluster 1689214002.2034233 mgr.a (mgr.14152) 1207 : cluster 0 pgmap v1082: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:43.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:43 smithi103 bash[27315]: cluster 1689214002.2034233 mgr.a (mgr.14152) 1207 : cluster 0 pgmap v1082: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:43.622 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:06:43.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:43 smithi084 bash[27323]: cluster 1689214002.2034233 mgr.a (mgr.14152) 1207 : cluster 0 pgmap v1082: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:43.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:43 smithi154 bash[27744]: cluster 1689214002.2034233 mgr.a (mgr.14152) 1207 : cluster 0 pgmap v1082: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:43.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:43 smithi137 bash[27262]: cluster 1689214002.2034233 mgr.a (mgr.14152) 1207 : cluster 0 pgmap v1082: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:44.358 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:06:44.611 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:44 smithi103 bash[27315]: audit 1689214003.6232636 mon.d (mon.3) 20 : audit 0 from='client.? 172.21.15.22:0/1993468283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:44.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:44 smithi084 bash[27323]: audit 1689214003.6232636 mon.d (mon.3) 20 : audit 0 from='client.? 172.21.15.22:0/1993468283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:44.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:44 smithi022 bash[26979]: audit 1689214003.6232636 mon.d (mon.3) 20 : audit 0 from='client.? 172.21.15.22:0/1993468283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:44.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:44 smithi154 bash[27744]: audit 1689214003.6232636 mon.d (mon.3) 20 : audit 0 from='client.? 172.21.15.22:0/1993468283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:44.811 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:44 smithi137 bash[27262]: audit 1689214003.6232636 mon.d (mon.3) 20 : audit 0 from='client.? 172.21.15.22:0/1993468283' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:45.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:06:45.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:45 smithi103 bash[27315]: cluster 1689214004.20398 mgr.a (mgr.14152) 1208 : cluster 0 pgmap v1083: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:45.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:45 smithi084 bash[27323]: cluster 1689214004.20398 mgr.a (mgr.14152) 1208 : cluster 0 pgmap v1083: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:45.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:45 smithi022 bash[26979]: cluster 1689214004.20398 mgr.a (mgr.14152) 1208 : cluster 0 pgmap v1083: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:45.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:45 smithi154 bash[27744]: cluster 1689214004.20398 mgr.a (mgr.14152) 1208 : cluster 0 pgmap v1083: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:45.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:45 smithi137 bash[27262]: cluster 1689214004.20398 mgr.a (mgr.14152) 1208 : cluster 0 pgmap v1083: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:47.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:47 smithi103 bash[27315]: cluster 1689214006.2045183 mgr.a (mgr.14152) 1209 : cluster 0 pgmap v1084: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:47.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:47 smithi084 bash[27323]: cluster 1689214006.2045183 mgr.a (mgr.14152) 1209 : cluster 0 pgmap v1084: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:47.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:47 smithi022 bash[26979]: cluster 1689214006.2045183 mgr.a (mgr.14152) 1209 : cluster 0 pgmap v1084: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:47.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:47 smithi154 bash[27744]: cluster 1689214006.2045183 mgr.a (mgr.14152) 1209 : cluster 0 pgmap v1084: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:47.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:47 smithi137 bash[27262]: cluster 1689214006.2045183 mgr.a (mgr.14152) 1209 : cluster 0 pgmap v1084: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:49.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:49 smithi103 bash[27315]: cluster 1689214008.2050498 mgr.a (mgr.14152) 1210 : cluster 0 pgmap v1085: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:49.650 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:49 smithi084 bash[27323]: cluster 1689214008.2050498 mgr.a (mgr.14152) 1210 : cluster 0 pgmap v1085: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:49.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:49 smithi022 bash[26979]: cluster 1689214008.2050498 mgr.a (mgr.14152) 1210 : cluster 0 pgmap v1085: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:49.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:49 smithi154 bash[27744]: cluster 1689214008.2050498 mgr.a (mgr.14152) 1210 : cluster 0 pgmap v1085: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:49.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:49 smithi137 bash[27262]: cluster 1689214008.2050498 mgr.a (mgr.14152) 1210 : cluster 0 pgmap v1085: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:50.054 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:06:51.415 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:51 smithi022 bash[26979]: cluster 1689214010.2056355 mgr.a (mgr.14152) 1211 : cluster 0 pgmap v1086: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:51.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:51 smithi103 bash[27315]: cluster 1689214010.2056355 mgr.a (mgr.14152) 1211 : cluster 0 pgmap v1086: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:51.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:51 smithi084 bash[27323]: cluster 1689214010.2056355 mgr.a (mgr.14152) 1211 : cluster 0 pgmap v1086: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:51.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:51 smithi154 bash[27744]: cluster 1689214010.2056355 mgr.a (mgr.14152) 1211 : cluster 0 pgmap v1086: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:51.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:51 smithi137 bash[27262]: cluster 1689214010.2056355 mgr.a (mgr.14152) 1211 : cluster 0 pgmap v1086: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:53.471 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:06:53.612 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:53 smithi103 bash[27315]: cluster 1689214012.2060606 mgr.a (mgr.14152) 1212 : cluster 0 pgmap v1087: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:53.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:53 smithi084 bash[27323]: cluster 1689214012.2060606 mgr.a (mgr.14152) 1212 : cluster 0 pgmap v1087: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:53.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:53 smithi022 bash[26979]: cluster 1689214012.2060606 mgr.a (mgr.14152) 1212 : cluster 0 pgmap v1087: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:53.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:53 smithi154 bash[27744]: cluster 1689214012.2060606 mgr.a (mgr.14152) 1212 : cluster 0 pgmap v1087: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:53.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:53 smithi137 bash[27262]: cluster 1689214012.2060606 mgr.a (mgr.14152) 1212 : cluster 0 pgmap v1087: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:54.254 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:06:54.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:54 smithi084 bash[27323]: audit 1689214013.4711983 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.22:0/2131996133' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:54.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:54 smithi022 bash[26979]: audit 1689214013.4711983 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.22:0/2131996133' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:54.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:54 smithi154 bash[27744]: audit 1689214013.4711983 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.22:0/2131996133' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:54.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:54 smithi137 bash[27262]: audit 1689214013.4711983 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.22:0/2131996133' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:54.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:54 smithi103 bash[27315]: audit 1689214013.4711983 mon.a (mon.0) 1234 : audit 0 from='client.? 172.21.15.22:0/2131996133' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:06:55.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:06:55.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:55 smithi084 bash[27323]: cluster 1689214014.2065961 mgr.a (mgr.14152) 1213 : cluster 0 pgmap v1088: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:55.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:55 smithi022 bash[26979]: cluster 1689214014.2065961 mgr.a (mgr.14152) 1213 : cluster 0 pgmap v1088: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:55.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:55 smithi154 bash[27744]: cluster 1689214014.2065961 mgr.a (mgr.14152) 1213 : cluster 0 pgmap v1088: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:55.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:55 smithi137 bash[27262]: cluster 1689214014.2065961 mgr.a (mgr.14152) 1213 : cluster 0 pgmap v1088: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:55.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:55 smithi103 bash[27315]: cluster 1689214014.2065961 mgr.a (mgr.14152) 1213 : cluster 0 pgmap v1088: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:57.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:57 smithi084 bash[27323]: cluster 1689214016.2071228 mgr.a (mgr.14152) 1214 : cluster 0 pgmap v1089: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:57.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:57 smithi022 bash[26979]: cluster 1689214016.2071228 mgr.a (mgr.14152) 1214 : cluster 0 pgmap v1089: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:57.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:57 smithi154 bash[27744]: cluster 1689214016.2071228 mgr.a (mgr.14152) 1214 : cluster 0 pgmap v1089: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:57.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:57 smithi137 bash[27262]: cluster 1689214016.2071228 mgr.a (mgr.14152) 1214 : cluster 0 pgmap v1089: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:57.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:57 smithi103 bash[27315]: cluster 1689214016.2071228 mgr.a (mgr.14152) 1214 : cluster 0 pgmap v1089: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:59.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:06:59 smithi084 bash[27323]: cluster 1689214018.2076707 mgr.a (mgr.14152) 1215 : cluster 0 pgmap v1090: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:59.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:06:59 smithi022 bash[26979]: cluster 1689214018.2076707 mgr.a (mgr.14152) 1215 : cluster 0 pgmap v1090: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:59.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:06:59 smithi154 bash[27744]: cluster 1689214018.2076707 mgr.a (mgr.14152) 1215 : cluster 0 pgmap v1090: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:59.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:06:59 smithi137 bash[27262]: cluster 1689214018.2076707 mgr.a (mgr.14152) 1215 : cluster 0 pgmap v1090: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:59.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:06:59 smithi103 bash[27315]: cluster 1689214018.2076707 mgr.a (mgr.14152) 1215 : cluster 0 pgmap v1090: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:06:59.948 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:01.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:01 smithi084 bash[27323]: cluster 1689214020.2080326 mgr.a (mgr.14152) 1216 : cluster 0 pgmap v1091: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:01.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:01 smithi022 bash[26979]: cluster 1689214020.2080326 mgr.a (mgr.14152) 1216 : cluster 0 pgmap v1091: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:01.765 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:01 smithi154 bash[27744]: cluster 1689214020.2080326 mgr.a (mgr.14152) 1216 : cluster 0 pgmap v1091: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:01.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:01 smithi137 bash[27262]: cluster 1689214020.2080326 mgr.a (mgr.14152) 1216 : cluster 0 pgmap v1091: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:01.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:01 smithi103 bash[27315]: cluster 1689214020.2080326 mgr.a (mgr.14152) 1216 : cluster 0 pgmap v1091: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:03.262 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:07:03.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:03 smithi084 bash[27323]: cluster 1689214022.208632 mgr.a (mgr.14152) 1217 : cluster 0 pgmap v1092: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:03.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:03 smithi084 bash[27323]: audit 1689214023.2619221 mon.a (mon.0) 1235 : audit 0 from='client.? 172.21.15.22:0/3395050552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:03.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:03 smithi022 bash[26979]: cluster 1689214022.208632 mgr.a (mgr.14152) 1217 : cluster 0 pgmap v1092: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:03.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:03 smithi022 bash[26979]: audit 1689214023.2619221 mon.a (mon.0) 1235 : audit 0 from='client.? 172.21.15.22:0/3395050552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:03.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:03 smithi154 bash[27744]: cluster 1689214022.208632 mgr.a (mgr.14152) 1217 : cluster 0 pgmap v1092: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:03.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:03 smithi154 bash[27744]: audit 1689214023.2619221 mon.a (mon.0) 1235 : audit 0 from='client.? 172.21.15.22:0/3395050552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:03.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:03 smithi137 bash[27262]: cluster 1689214022.208632 mgr.a (mgr.14152) 1217 : cluster 0 pgmap v1092: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:03.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:03 smithi137 bash[27262]: audit 1689214023.2619221 mon.a (mon.0) 1235 : audit 0 from='client.? 172.21.15.22:0/3395050552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:03.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:03 smithi103 bash[27315]: cluster 1689214022.208632 mgr.a (mgr.14152) 1217 : cluster 0 pgmap v1092: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:03.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:03 smithi103 bash[27315]: audit 1689214023.2619221 mon.a (mon.0) 1235 : audit 0 from='client.? 172.21.15.22:0/3395050552' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:04.017 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:07:05.018 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:07:05.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:05 smithi084 bash[27323]: cluster 1689214024.2093062 mgr.a (mgr.14152) 1218 : cluster 0 pgmap v1093: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:05.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:05 smithi022 bash[26979]: cluster 1689214024.2093062 mgr.a (mgr.14152) 1218 : cluster 0 pgmap v1093: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:05.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:05 smithi154 bash[27744]: cluster 1689214024.2093062 mgr.a (mgr.14152) 1218 : cluster 0 pgmap v1093: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:05.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:05 smithi137 bash[27262]: cluster 1689214024.2093062 mgr.a (mgr.14152) 1218 : cluster 0 pgmap v1093: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:05.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:05 smithi103 bash[27315]: cluster 1689214024.2093062 mgr.a (mgr.14152) 1218 : cluster 0 pgmap v1093: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:07.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:07 smithi084 bash[27323]: cluster 1689214026.209848 mgr.a (mgr.14152) 1219 : cluster 0 pgmap v1094: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:07.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:07 smithi022 bash[26979]: cluster 1689214026.209848 mgr.a (mgr.14152) 1219 : cluster 0 pgmap v1094: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:07.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:07 smithi154 bash[27744]: cluster 1689214026.209848 mgr.a (mgr.14152) 1219 : cluster 0 pgmap v1094: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:07.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:07 smithi137 bash[27262]: cluster 1689214026.209848 mgr.a (mgr.14152) 1219 : cluster 0 pgmap v1094: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:07.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:07 smithi103 bash[27315]: cluster 1689214026.209848 mgr.a (mgr.14152) 1219 : cluster 0 pgmap v1094: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:09.651 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:09 smithi084 bash[27323]: cluster 1689214028.2103932 mgr.a (mgr.14152) 1220 : cluster 0 pgmap v1095: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:09.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:09 smithi022 bash[26979]: cluster 1689214028.2103932 mgr.a (mgr.14152) 1220 : cluster 0 pgmap v1095: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:09.719 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:09.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:09 smithi154 bash[27744]: cluster 1689214028.2103932 mgr.a (mgr.14152) 1220 : cluster 0 pgmap v1095: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:09.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:09 smithi137 bash[27262]: cluster 1689214028.2103932 mgr.a (mgr.14152) 1220 : cluster 0 pgmap v1095: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:09.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:09 smithi103 bash[27315]: cluster 1689214028.2103932 mgr.a (mgr.14152) 1220 : cluster 0 pgmap v1095: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:11.658 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:11 smithi022 bash[26979]: cluster 1689214030.2109509 mgr.a (mgr.14152) 1221 : cluster 0 pgmap v1096: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:11.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:11 smithi154 bash[27744]: cluster 1689214030.2109509 mgr.a (mgr.14152) 1221 : cluster 0 pgmap v1096: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:11.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:11 smithi137 bash[27262]: cluster 1689214030.2109509 mgr.a (mgr.14152) 1221 : cluster 0 pgmap v1096: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:11.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:11 smithi103 bash[27315]: cluster 1689214030.2109509 mgr.a (mgr.14152) 1221 : cluster 0 pgmap v1096: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:11.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:11 smithi084 bash[27323]: cluster 1689214030.2109509 mgr.a (mgr.14152) 1221 : cluster 0 pgmap v1096: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:13.058 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:07:13.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:13 smithi022 bash[26979]: cluster 1689214032.2114139 mgr.a (mgr.14152) 1222 : cluster 0 pgmap v1097: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:13.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:13 smithi022 bash[26979]: audit 1689214033.0574446 mon.a (mon.0) 1236 : audit 0 from='client.? 172.21.15.22:0/2892938573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:13.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:13 smithi154 bash[27744]: cluster 1689214032.2114139 mgr.a (mgr.14152) 1222 : cluster 0 pgmap v1097: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:13.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:13 smithi154 bash[27744]: audit 1689214033.0574446 mon.a (mon.0) 1236 : audit 0 from='client.? 172.21.15.22:0/2892938573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:13.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:13 smithi137 bash[27262]: cluster 1689214032.2114139 mgr.a (mgr.14152) 1222 : cluster 0 pgmap v1097: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:13.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:13 smithi137 bash[27262]: audit 1689214033.0574446 mon.a (mon.0) 1236 : audit 0 from='client.? 172.21.15.22:0/2892938573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:13.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:13 smithi103 bash[27315]: cluster 1689214032.2114139 mgr.a (mgr.14152) 1222 : cluster 0 pgmap v1097: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:13.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:13 smithi103 bash[27315]: audit 1689214033.0574446 mon.a (mon.0) 1236 : audit 0 from='client.? 172.21.15.22:0/2892938573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:13.872 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:07:13.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:13 smithi084 bash[27323]: cluster 1689214032.2114139 mgr.a (mgr.14152) 1222 : cluster 0 pgmap v1097: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:13.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:13 smithi084 bash[27323]: audit 1689214033.0574446 mon.a (mon.0) 1236 : audit 0 from='client.? 172.21.15.22:0/2892938573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:14.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:07:15.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:15 smithi022 bash[26979]: cluster 1689214034.211958 mgr.a (mgr.14152) 1223 : cluster 0 pgmap v1098: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:15.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:15 smithi154 bash[27744]: cluster 1689214034.211958 mgr.a (mgr.14152) 1223 : cluster 0 pgmap v1098: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:15.812 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:15 smithi137 bash[27262]: cluster 1689214034.211958 mgr.a (mgr.14152) 1223 : cluster 0 pgmap v1098: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:15.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:15 smithi103 bash[27315]: cluster 1689214034.211958 mgr.a (mgr.14152) 1223 : cluster 0 pgmap v1098: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:15.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:15 smithi084 bash[27323]: cluster 1689214034.211958 mgr.a (mgr.14152) 1223 : cluster 0 pgmap v1098: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:17.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:17 smithi022 bash[26979]: cluster 1689214036.212492 mgr.a (mgr.14152) 1224 : cluster 0 pgmap v1099: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:17.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:17 smithi154 bash[27744]: cluster 1689214036.212492 mgr.a (mgr.14152) 1224 : cluster 0 pgmap v1099: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:17.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:17 smithi137 bash[27262]: cluster 1689214036.212492 mgr.a (mgr.14152) 1224 : cluster 0 pgmap v1099: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:17.862 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:17 smithi103 bash[27315]: cluster 1689214036.212492 mgr.a (mgr.14152) 1224 : cluster 0 pgmap v1099: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:17.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:17 smithi084 bash[27323]: cluster 1689214036.212492 mgr.a (mgr.14152) 1224 : cluster 0 pgmap v1099: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:19.572 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:19.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:19 smithi154 bash[27744]: cluster 1689214038.2130222 mgr.a (mgr.14152) 1225 : cluster 0 pgmap v1100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:19.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:19 smithi137 bash[27262]: cluster 1689214038.2130222 mgr.a (mgr.14152) 1225 : cluster 0 pgmap v1100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:19.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:19 smithi103 bash[27315]: cluster 1689214038.2130222 mgr.a (mgr.14152) 1225 : cluster 0 pgmap v1100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:19.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:19 smithi084 bash[27323]: cluster 1689214038.2130222 mgr.a (mgr.14152) 1225 : cluster 0 pgmap v1100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:19.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:19 smithi022 bash[26979]: cluster 1689214038.2130222 mgr.a (mgr.14152) 1225 : cluster 0 pgmap v1100: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:21.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:21 smithi154 bash[27744]: cluster 1689214040.2135878 mgr.a (mgr.14152) 1226 : cluster 0 pgmap v1101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:21.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:21 smithi137 bash[27262]: cluster 1689214040.2135878 mgr.a (mgr.14152) 1226 : cluster 0 pgmap v1101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:21.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:21 smithi103 bash[27315]: cluster 1689214040.2135878 mgr.a (mgr.14152) 1226 : cluster 0 pgmap v1101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:21.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:21 smithi084 bash[27323]: cluster 1689214040.2135878 mgr.a (mgr.14152) 1226 : cluster 0 pgmap v1101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:21.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:21 smithi022 bash[26979]: cluster 1689214040.2135878 mgr.a (mgr.14152) 1226 : cluster 0 pgmap v1101: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:22.998 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:07:23.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:23 smithi022 bash[26979]: cluster 1689214042.2140443 mgr.a (mgr.14152) 1227 : cluster 0 pgmap v1102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:23.666 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:23 smithi022 bash[26979]: audit 1689214042.9967258 mon.a (mon.0) 1237 : audit 0 from='client.? 172.21.15.22:0/436226715' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:23.752 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:07:23.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:23 smithi154 bash[27744]: cluster 1689214042.2140443 mgr.a (mgr.14152) 1227 : cluster 0 pgmap v1102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:23.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:23 smithi154 bash[27744]: audit 1689214042.9967258 mon.a (mon.0) 1237 : audit 0 from='client.? 172.21.15.22:0/436226715' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:23.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:23 smithi137 bash[27262]: cluster 1689214042.2140443 mgr.a (mgr.14152) 1227 : cluster 0 pgmap v1102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:23.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:23 smithi137 bash[27262]: audit 1689214042.9967258 mon.a (mon.0) 1237 : audit 0 from='client.? 172.21.15.22:0/436226715' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:23.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:23 smithi103 bash[27315]: cluster 1689214042.2140443 mgr.a (mgr.14152) 1227 : cluster 0 pgmap v1102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:23.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:23 smithi103 bash[27315]: audit 1689214042.9967258 mon.a (mon.0) 1237 : audit 0 from='client.? 172.21.15.22:0/436226715' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:23.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:23 smithi084 bash[27323]: cluster 1689214042.2140443 mgr.a (mgr.14152) 1227 : cluster 0 pgmap v1102: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:23.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:23 smithi084 bash[27323]: audit 1689214042.9967258 mon.a (mon.0) 1237 : audit 0 from='client.? 172.21.15.22:0/436226715' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:24.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:07:25.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:25 smithi154 bash[27744]: cluster 1689214044.214533 mgr.a (mgr.14152) 1228 : cluster 0 pgmap v1103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:25.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:25 smithi137 bash[27262]: cluster 1689214044.214533 mgr.a (mgr.14152) 1228 : cluster 0 pgmap v1103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:25.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:25 smithi103 bash[27315]: cluster 1689214044.214533 mgr.a (mgr.14152) 1228 : cluster 0 pgmap v1103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:25.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:25 smithi084 bash[27323]: cluster 1689214044.214533 mgr.a (mgr.14152) 1228 : cluster 0 pgmap v1103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:25.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:25 smithi022 bash[26979]: cluster 1689214044.214533 mgr.a (mgr.14152) 1228 : cluster 0 pgmap v1103: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:27.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:27 smithi154 bash[27744]: cluster 1689214046.2150807 mgr.a (mgr.14152) 1229 : cluster 0 pgmap v1104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:27.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:27 smithi137 bash[27262]: cluster 1689214046.2150807 mgr.a (mgr.14152) 1229 : cluster 0 pgmap v1104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:27.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:27 smithi103 bash[27315]: cluster 1689214046.2150807 mgr.a (mgr.14152) 1229 : cluster 0 pgmap v1104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:27.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:27 smithi084 bash[27323]: cluster 1689214046.2150807 mgr.a (mgr.14152) 1229 : cluster 0 pgmap v1104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:27.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:27 smithi022 bash[26979]: cluster 1689214046.2150807 mgr.a (mgr.14152) 1229 : cluster 0 pgmap v1104: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:29.448 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:29.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:29 smithi154 bash[27744]: cluster 1689214048.215554 mgr.a (mgr.14152) 1230 : cluster 0 pgmap v1105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:29.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:29 smithi137 bash[27262]: cluster 1689214048.215554 mgr.a (mgr.14152) 1230 : cluster 0 pgmap v1105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:29.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:29 smithi103 bash[27315]: cluster 1689214048.215554 mgr.a (mgr.14152) 1230 : cluster 0 pgmap v1105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:29.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:29 smithi084 bash[27323]: cluster 1689214048.215554 mgr.a (mgr.14152) 1230 : cluster 0 pgmap v1105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:29.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:29 smithi022 bash[26979]: cluster 1689214048.215554 mgr.a (mgr.14152) 1230 : cluster 0 pgmap v1105: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:31.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:31 smithi154 bash[27744]: cluster 1689214050.2160428 mgr.a (mgr.14152) 1231 : cluster 0 pgmap v1106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:31.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:31 smithi137 bash[27262]: cluster 1689214050.2160428 mgr.a (mgr.14152) 1231 : cluster 0 pgmap v1106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:31.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:31 smithi103 bash[27315]: cluster 1689214050.2160428 mgr.a (mgr.14152) 1231 : cluster 0 pgmap v1106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:31.901 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:31 smithi084 bash[27323]: cluster 1689214050.2160428 mgr.a (mgr.14152) 1231 : cluster 0 pgmap v1106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:31.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:31 smithi022 bash[26979]: cluster 1689214050.2160428 mgr.a (mgr.14152) 1231 : cluster 0 pgmap v1106: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:32.750 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:07:33.478 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:07:33.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:33 smithi154 bash[27744]: cluster 1689214052.2166154 mgr.a (mgr.14152) 1232 : cluster 0 pgmap v1107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:33.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:33 smithi154 bash[27744]: audit 1689214052.749549 mon.d (mon.3) 21 : audit 0 from='client.? 172.21.15.22:0/2497064951' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:33.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:33 smithi137 bash[27262]: cluster 1689214052.2166154 mgr.a (mgr.14152) 1232 : cluster 0 pgmap v1107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:33.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:33 smithi137 bash[27262]: audit 1689214052.749549 mon.d (mon.3) 21 : audit 0 from='client.? 172.21.15.22:0/2497064951' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:33.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:33 smithi103 bash[27315]: cluster 1689214052.2166154 mgr.a (mgr.14152) 1232 : cluster 0 pgmap v1107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:33.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:33 smithi103 bash[27315]: audit 1689214052.749549 mon.d (mon.3) 21 : audit 0 from='client.? 172.21.15.22:0/2497064951' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:33.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:33 smithi084 bash[27323]: cluster 1689214052.2166154 mgr.a (mgr.14152) 1232 : cluster 0 pgmap v1107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:33.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:33 smithi084 bash[27323]: audit 1689214052.749549 mon.d (mon.3) 21 : audit 0 from='client.? 172.21.15.22:0/2497064951' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:33.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:33 smithi022 bash[26979]: cluster 1689214052.2166154 mgr.a (mgr.14152) 1232 : cluster 0 pgmap v1107: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:33.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:33 smithi022 bash[26979]: audit 1689214052.749549 mon.d (mon.3) 21 : audit 0 from='client.? 172.21.15.22:0/2497064951' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:34.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:07:35.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:35 smithi154 bash[27744]: cluster 1689214054.2171843 mgr.a (mgr.14152) 1233 : cluster 0 pgmap v1108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:35.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:35 smithi137 bash[27262]: cluster 1689214054.2171843 mgr.a (mgr.14152) 1233 : cluster 0 pgmap v1108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:35.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:35 smithi103 bash[27315]: cluster 1689214054.2171843 mgr.a (mgr.14152) 1233 : cluster 0 pgmap v1108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:35.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:35 smithi084 bash[27323]: cluster 1689214054.2171843 mgr.a (mgr.14152) 1233 : cluster 0 pgmap v1108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:35.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:35 smithi022 bash[26979]: cluster 1689214054.2171843 mgr.a (mgr.14152) 1233 : cluster 0 pgmap v1108: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:36.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:36 smithi154 bash[27744]: audit 1689214056.3773098 mon.a (mon.0) 1238 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:07:36.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:36 smithi137 bash[27262]: audit 1689214056.3773098 mon.a (mon.0) 1238 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:07:36.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:36 smithi103 bash[27315]: audit 1689214056.3773098 mon.a (mon.0) 1238 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:07:36.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:36 smithi084 bash[27323]: audit 1689214056.3773098 mon.a (mon.0) 1238 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:07:36.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:36 smithi022 bash[26979]: audit 1689214056.3773098 mon.a (mon.0) 1238 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:07:37.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:37 smithi154 bash[27744]: cluster 1689214056.217761 mgr.a (mgr.14152) 1234 : cluster 0 pgmap v1109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:37.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:37 smithi154 bash[27744]: audit 1689214057.189382 mon.a (mon.0) 1239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:07:37.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:37 smithi154 bash[27744]: audit 1689214057.1909912 mon.a (mon.0) 1240 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:07:37.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:37 smithi154 bash[27744]: audit 1689214057.2012932 mon.a (mon.0) 1241 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:07:37.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:37 smithi137 bash[27262]: cluster 1689214056.217761 mgr.a (mgr.14152) 1234 : cluster 0 pgmap v1109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:37.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:37 smithi137 bash[27262]: audit 1689214057.189382 mon.a (mon.0) 1239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:07:37.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:37 smithi137 bash[27262]: audit 1689214057.1909912 mon.a (mon.0) 1240 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:07:37.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:37 smithi137 bash[27262]: audit 1689214057.2012932 mon.a (mon.0) 1241 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:07:37.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:37 smithi103 bash[27315]: cluster 1689214056.217761 mgr.a (mgr.14152) 1234 : cluster 0 pgmap v1109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:37.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:37 smithi103 bash[27315]: audit 1689214057.189382 mon.a (mon.0) 1239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:07:37.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:37 smithi103 bash[27315]: audit 1689214057.1909912 mon.a (mon.0) 1240 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:07:37.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:37 smithi103 bash[27315]: audit 1689214057.2012932 mon.a (mon.0) 1241 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:07:37.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:37 smithi084 bash[27323]: cluster 1689214056.217761 mgr.a (mgr.14152) 1234 : cluster 0 pgmap v1109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:37.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:37 smithi084 bash[27323]: audit 1689214057.189382 mon.a (mon.0) 1239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:07:37.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:37 smithi084 bash[27323]: audit 1689214057.1909912 mon.a (mon.0) 1240 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:07:37.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:37 smithi084 bash[27323]: audit 1689214057.2012932 mon.a (mon.0) 1241 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:07:37.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:37 smithi022 bash[26979]: cluster 1689214056.217761 mgr.a (mgr.14152) 1234 : cluster 0 pgmap v1109: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:37.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:37 smithi022 bash[26979]: audit 1689214057.189382 mon.a (mon.0) 1239 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:07:37.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:37 smithi022 bash[26979]: audit 1689214057.1909912 mon.a (mon.0) 1240 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:07:37.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:37 smithi022 bash[26979]: audit 1689214057.2012932 mon.a (mon.0) 1241 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:07:38.766 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:38 smithi154 bash[27744]: cluster 1689214057.1935928 mgr.a (mgr.14152) 1235 : cluster 0 pgmap v1110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:38 smithi154 bash[27744]: cluster 1689214057.1938846 mgr.a (mgr.14152) 1236 : cluster 0 pgmap v1111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:38 smithi137 bash[27262]: cluster 1689214057.1935928 mgr.a (mgr.14152) 1235 : cluster 0 pgmap v1110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:38 smithi137 bash[27262]: cluster 1689214057.1938846 mgr.a (mgr.14152) 1236 : cluster 0 pgmap v1111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:38 smithi103 bash[27315]: cluster 1689214057.1935928 mgr.a (mgr.14152) 1235 : cluster 0 pgmap v1110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:38 smithi103 bash[27315]: cluster 1689214057.1938846 mgr.a (mgr.14152) 1236 : cluster 0 pgmap v1111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:38 smithi084 bash[27323]: cluster 1689214057.1935928 mgr.a (mgr.14152) 1235 : cluster 0 pgmap v1110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:38 smithi084 bash[27323]: cluster 1689214057.1938846 mgr.a (mgr.14152) 1236 : cluster 0 pgmap v1111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:38 smithi022 bash[26979]: cluster 1689214057.1935928 mgr.a (mgr.14152) 1235 : cluster 0 pgmap v1110: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:38.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:38 smithi022 bash[26979]: cluster 1689214057.1938846 mgr.a (mgr.14152) 1236 : cluster 0 pgmap v1111: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:39.171 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:40.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:40 smithi154 bash[27744]: cluster 1689214059.194359 mgr.a (mgr.14152) 1237 : cluster 0 pgmap v1112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:40.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:40 smithi137 bash[27262]: cluster 1689214059.194359 mgr.a (mgr.14152) 1237 : cluster 0 pgmap v1112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:40.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:40 smithi103 bash[27315]: cluster 1689214059.194359 mgr.a (mgr.14152) 1237 : cluster 0 pgmap v1112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:40.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:40 smithi084 bash[27323]: cluster 1689214059.194359 mgr.a (mgr.14152) 1237 : cluster 0 pgmap v1112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:40.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:40 smithi022 bash[26979]: cluster 1689214059.194359 mgr.a (mgr.14152) 1237 : cluster 0 pgmap v1112: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:42.499 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:07:42.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:42 smithi154 bash[27744]: cluster 1689214061.1948807 mgr.a (mgr.14152) 1238 : cluster 0 pgmap v1113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:42.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:42 smithi137 bash[27262]: cluster 1689214061.1948807 mgr.a (mgr.14152) 1238 : cluster 0 pgmap v1113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:42.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:42 smithi103 bash[27315]: cluster 1689214061.1948807 mgr.a (mgr.14152) 1238 : cluster 0 pgmap v1113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:42.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:42 smithi084 bash[27323]: cluster 1689214061.1948807 mgr.a (mgr.14152) 1238 : cluster 0 pgmap v1113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:42.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:42 smithi022 bash[26979]: cluster 1689214061.1948807 mgr.a (mgr.14152) 1238 : cluster 0 pgmap v1113: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:43.230 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:07:43.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:43 smithi154 bash[27744]: audit 1689214062.4978638 mon.a (mon.0) 1242 : audit 0 from='client.? 172.21.15.22:0/2057326309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:43.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:43 smithi137 bash[27262]: audit 1689214062.4978638 mon.a (mon.0) 1242 : audit 0 from='client.? 172.21.15.22:0/2057326309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:43.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:43 smithi103 bash[27315]: audit 1689214062.4978638 mon.a (mon.0) 1242 : audit 0 from='client.? 172.21.15.22:0/2057326309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:43.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:43 smithi084 bash[27323]: audit 1689214062.4978638 mon.a (mon.0) 1242 : audit 0 from='client.? 172.21.15.22:0/2057326309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:43.916 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:43 smithi022 bash[26979]: audit 1689214062.4978638 mon.a (mon.0) 1242 : audit 0 from='client.? 172.21.15.22:0/2057326309' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:44.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:07:44.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:44 smithi154 bash[27744]: cluster 1689214063.1954305 mgr.a (mgr.14152) 1239 : cluster 0 pgmap v1114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:44.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:44 smithi137 bash[27262]: cluster 1689214063.1954305 mgr.a (mgr.14152) 1239 : cluster 0 pgmap v1114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:44.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:44 smithi103 bash[27315]: cluster 1689214063.1954305 mgr.a (mgr.14152) 1239 : cluster 0 pgmap v1114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:44.902 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:44 smithi084 bash[27323]: cluster 1689214063.1954305 mgr.a (mgr.14152) 1239 : cluster 0 pgmap v1114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:44.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:44 smithi022 bash[26979]: cluster 1689214063.1954305 mgr.a (mgr.14152) 1239 : cluster 0 pgmap v1114: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:46.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:46 smithi103 bash[27315]: cluster 1689214065.1960022 mgr.a (mgr.14152) 1240 : cluster 0 pgmap v1115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:46.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:46 smithi084 bash[27323]: cluster 1689214065.1960022 mgr.a (mgr.14152) 1240 : cluster 0 pgmap v1115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:46.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:46 smithi022 bash[26979]: cluster 1689214065.1960022 mgr.a (mgr.14152) 1240 : cluster 0 pgmap v1115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:46.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:46 smithi154 bash[27744]: cluster 1689214065.1960022 mgr.a (mgr.14152) 1240 : cluster 0 pgmap v1115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:46.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:46 smithi137 bash[27262]: cluster 1689214065.1960022 mgr.a (mgr.14152) 1240 : cluster 0 pgmap v1115: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:48.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:48 smithi103 bash[27315]: cluster 1689214067.1965506 mgr.a (mgr.14152) 1241 : cluster 0 pgmap v1116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:48.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:48 smithi084 bash[27323]: cluster 1689214067.1965506 mgr.a (mgr.14152) 1241 : cluster 0 pgmap v1116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:48.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:48 smithi022 bash[26979]: cluster 1689214067.1965506 mgr.a (mgr.14152) 1241 : cluster 0 pgmap v1116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:48.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:48 smithi154 bash[27744]: cluster 1689214067.1965506 mgr.a (mgr.14152) 1241 : cluster 0 pgmap v1116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:48.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:48 smithi137 bash[27262]: cluster 1689214067.1965506 mgr.a (mgr.14152) 1241 : cluster 0 pgmap v1116: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:48.923 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:50.613 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:50 smithi103 bash[27315]: cluster 1689214069.1970997 mgr.a (mgr.14152) 1242 : cluster 0 pgmap v1117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:50.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:50 smithi084 bash[27323]: cluster 1689214069.1970997 mgr.a (mgr.14152) 1242 : cluster 0 pgmap v1117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:50.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:50 smithi022 bash[26979]: cluster 1689214069.1970997 mgr.a (mgr.14152) 1242 : cluster 0 pgmap v1117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:50.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:50 smithi154 bash[27744]: cluster 1689214069.1970997 mgr.a (mgr.14152) 1242 : cluster 0 pgmap v1117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:50.813 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:50 smithi137 bash[27262]: cluster 1689214069.1970997 mgr.a (mgr.14152) 1242 : cluster 0 pgmap v1117: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:52.343 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:07:52.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:52 smithi084 bash[27323]: cluster 1689214071.197644 mgr.a (mgr.14152) 1243 : cluster 0 pgmap v1118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:52.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:52 smithi084 bash[27323]: audit 1689214072.3410356 mon.a (mon.0) 1243 : audit 0 from='client.? 172.21.15.22:0/988255020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:52.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:52 smithi022 bash[26979]: cluster 1689214071.197644 mgr.a (mgr.14152) 1243 : cluster 0 pgmap v1118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:52.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:52 smithi022 bash[26979]: audit 1689214072.3410356 mon.a (mon.0) 1243 : audit 0 from='client.? 172.21.15.22:0/988255020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:52.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:52 smithi154 bash[27744]: cluster 1689214071.197644 mgr.a (mgr.14152) 1243 : cluster 0 pgmap v1118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:52.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:52 smithi154 bash[27744]: audit 1689214072.3410356 mon.a (mon.0) 1243 : audit 0 from='client.? 172.21.15.22:0/988255020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:52.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:52 smithi137 bash[27262]: cluster 1689214071.197644 mgr.a (mgr.14152) 1243 : cluster 0 pgmap v1118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:52.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:52 smithi137 bash[27262]: audit 1689214072.3410356 mon.a (mon.0) 1243 : audit 0 from='client.? 172.21.15.22:0/988255020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:52.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:52 smithi103 bash[27315]: cluster 1689214071.197644 mgr.a (mgr.14152) 1243 : cluster 0 pgmap v1118: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:52.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:52 smithi103 bash[27315]: audit 1689214072.3410356 mon.a (mon.0) 1243 : audit 0 from='client.? 172.21.15.22:0/988255020' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:07:53.101 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:07:54.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:07:54.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:54 smithi084 bash[27323]: cluster 1689214073.198161 mgr.a (mgr.14152) 1244 : cluster 0 pgmap v1119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:54.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:54 smithi022 bash[26979]: cluster 1689214073.198161 mgr.a (mgr.14152) 1244 : cluster 0 pgmap v1119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:54.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:54 smithi154 bash[27744]: cluster 1689214073.198161 mgr.a (mgr.14152) 1244 : cluster 0 pgmap v1119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:54.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:54 smithi137 bash[27262]: cluster 1689214073.198161 mgr.a (mgr.14152) 1244 : cluster 0 pgmap v1119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:54.863 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:54 smithi103 bash[27315]: cluster 1689214073.198161 mgr.a (mgr.14152) 1244 : cluster 0 pgmap v1119: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:56.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:56 smithi084 bash[27323]: cluster 1689214075.1986897 mgr.a (mgr.14152) 1245 : cluster 0 pgmap v1120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:56.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:56 smithi022 bash[26979]: cluster 1689214075.1986897 mgr.a (mgr.14152) 1245 : cluster 0 pgmap v1120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:56.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:56 smithi154 bash[27744]: cluster 1689214075.1986897 mgr.a (mgr.14152) 1245 : cluster 0 pgmap v1120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:56.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:56 smithi137 bash[27262]: cluster 1689214075.1986897 mgr.a (mgr.14152) 1245 : cluster 0 pgmap v1120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:56.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:56 smithi103 bash[27315]: cluster 1689214075.1986897 mgr.a (mgr.14152) 1245 : cluster 0 pgmap v1120: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:58.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:07:58 smithi084 bash[27323]: cluster 1689214077.1992302 mgr.a (mgr.14152) 1246 : cluster 0 pgmap v1121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:58.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:07:58 smithi022 bash[26979]: cluster 1689214077.1992302 mgr.a (mgr.14152) 1246 : cluster 0 pgmap v1121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:58.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:07:58 smithi154 bash[27744]: cluster 1689214077.1992302 mgr.a (mgr.14152) 1246 : cluster 0 pgmap v1121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:58.792 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:07:58.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:07:58 smithi137 bash[27262]: cluster 1689214077.1992302 mgr.a (mgr.14152) 1246 : cluster 0 pgmap v1121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:07:58.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:07:58 smithi103 bash[27315]: cluster 1689214077.1992302 mgr.a (mgr.14152) 1246 : cluster 0 pgmap v1121: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:00.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:00 smithi084 bash[27323]: cluster 1689214079.1997855 mgr.a (mgr.14152) 1247 : cluster 0 pgmap v1122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:00.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:00 smithi022 bash[26979]: cluster 1689214079.1997855 mgr.a (mgr.14152) 1247 : cluster 0 pgmap v1122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:00.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:00 smithi154 bash[27744]: cluster 1689214079.1997855 mgr.a (mgr.14152) 1247 : cluster 0 pgmap v1122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:00.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:00 smithi137 bash[27262]: cluster 1689214079.1997855 mgr.a (mgr.14152) 1247 : cluster 0 pgmap v1122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:00.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:00 smithi103 bash[27315]: cluster 1689214079.1997855 mgr.a (mgr.14152) 1247 : cluster 0 pgmap v1122: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:08:02.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:02 smithi084 bash[27323]: cluster 1689214081.200103 mgr.a (mgr.14152) 1248 : cluster 0 pgmap v1123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:02.653 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:02 smithi084 bash[27323]: audit 1689214082.2570224 mon.a (mon.0) 1244 : audit 0 from='client.? 172.21.15.22:0/2498729532' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:02.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:02 smithi022 bash[26979]: cluster 1689214081.200103 mgr.a (mgr.14152) 1248 : cluster 0 pgmap v1123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:02.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:02 smithi022 bash[26979]: audit 1689214082.2570224 mon.a (mon.0) 1244 : audit 0 from='client.? 172.21.15.22:0/2498729532' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:02.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:02 smithi154 bash[27744]: cluster 1689214081.200103 mgr.a (mgr.14152) 1248 : cluster 0 pgmap v1123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:02.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:02 smithi154 bash[27744]: audit 1689214082.2570224 mon.a (mon.0) 1244 : audit 0 from='client.? 172.21.15.22:0/2498729532' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:02.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:02 smithi137 bash[27262]: cluster 1689214081.200103 mgr.a (mgr.14152) 1248 : cluster 0 pgmap v1123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:02.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:02 smithi137 bash[27262]: audit 1689214082.2570224 mon.a (mon.0) 1244 : audit 0 from='client.? 172.21.15.22:0/2498729532' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:02.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:02 smithi103 bash[27315]: cluster 1689214081.200103 mgr.a (mgr.14152) 1248 : cluster 0 pgmap v1123: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:02.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:02 smithi103 bash[27315]: audit 1689214082.2570224 mon.a (mon.0) 1244 : audit 0 from='client.? 172.21.15.22:0/2498729532' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:03.093 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:08:04.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:08:04.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:04 smithi084 bash[27323]: cluster 1689214083.2006104 mgr.a (mgr.14152) 1249 : cluster 0 pgmap v1124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:04.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:04 smithi022 bash[26979]: cluster 1689214083.2006104 mgr.a (mgr.14152) 1249 : cluster 0 pgmap v1124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:04.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:04 smithi154 bash[27744]: cluster 1689214083.2006104 mgr.a (mgr.14152) 1249 : cluster 0 pgmap v1124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:04.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:04 smithi137 bash[27262]: cluster 1689214083.2006104 mgr.a (mgr.14152) 1249 : cluster 0 pgmap v1124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:04.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:04 smithi103 bash[27315]: cluster 1689214083.2006104 mgr.a (mgr.14152) 1249 : cluster 0 pgmap v1124: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:06.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:06 smithi084 bash[27323]: cluster 1689214085.201137 mgr.a (mgr.14152) 1250 : cluster 0 pgmap v1125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:06.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:06 smithi022 bash[26979]: cluster 1689214085.201137 mgr.a (mgr.14152) 1250 : cluster 0 pgmap v1125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:06.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:06 smithi154 bash[27744]: cluster 1689214085.201137 mgr.a (mgr.14152) 1250 : cluster 0 pgmap v1125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:06.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:06 smithi137 bash[27262]: cluster 1689214085.201137 mgr.a (mgr.14152) 1250 : cluster 0 pgmap v1125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:06.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:06 smithi103 bash[27315]: cluster 1689214085.201137 mgr.a (mgr.14152) 1250 : cluster 0 pgmap v1125: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:08.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:08 smithi084 bash[27323]: cluster 1689214087.2017536 mgr.a (mgr.14152) 1251 : cluster 0 pgmap v1126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:08.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:08 smithi022 bash[26979]: cluster 1689214087.2017536 mgr.a (mgr.14152) 1251 : cluster 0 pgmap v1126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:08.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:08 smithi154 bash[27744]: cluster 1689214087.2017536 mgr.a (mgr.14152) 1251 : cluster 0 pgmap v1126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:08.790 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:08:08.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:08 smithi137 bash[27262]: cluster 1689214087.2017536 mgr.a (mgr.14152) 1251 : cluster 0 pgmap v1126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:08.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:08 smithi103 bash[27315]: cluster 1689214087.2017536 mgr.a (mgr.14152) 1251 : cluster 0 pgmap v1126: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:10.652 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:10 smithi084 bash[27323]: cluster 1689214089.2022662 mgr.a (mgr.14152) 1252 : cluster 0 pgmap v1127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:10.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:10 smithi022 bash[26979]: cluster 1689214089.2022662 mgr.a (mgr.14152) 1252 : cluster 0 pgmap v1127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:10.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:10 smithi154 bash[27744]: cluster 1689214089.2022662 mgr.a (mgr.14152) 1252 : cluster 0 pgmap v1127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:10.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:10 smithi137 bash[27262]: cluster 1689214089.2022662 mgr.a (mgr.14152) 1252 : cluster 0 pgmap v1127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:10.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:10 smithi103 bash[27315]: cluster 1689214089.2022662 mgr.a (mgr.14152) 1252 : cluster 0 pgmap v1127: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:12.221 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:08:12.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:12 smithi022 bash[26979]: cluster 1689214091.2027788 mgr.a (mgr.14152) 1253 : cluster 0 pgmap v1128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:12.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:12 smithi022 bash[26979]: audit 1689214092.2190688 mon.a (mon.0) 1245 : audit 0 from='client.? 172.21.15.22:0/1897380487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:12.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:12 smithi154 bash[27744]: cluster 1689214091.2027788 mgr.a (mgr.14152) 1253 : cluster 0 pgmap v1128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:12.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:12 smithi154 bash[27744]: audit 1689214092.2190688 mon.a (mon.0) 1245 : audit 0 from='client.? 172.21.15.22:0/1897380487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:12.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:12 smithi137 bash[27262]: cluster 1689214091.2027788 mgr.a (mgr.14152) 1253 : cluster 0 pgmap v1128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:12.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:12 smithi137 bash[27262]: audit 1689214092.2190688 mon.a (mon.0) 1245 : audit 0 from='client.? 172.21.15.22:0/1897380487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:12.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:12 smithi103 bash[27315]: cluster 1689214091.2027788 mgr.a (mgr.14152) 1253 : cluster 0 pgmap v1128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:12.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:12 smithi103 bash[27315]: audit 1689214092.2190688 mon.a (mon.0) 1245 : audit 0 from='client.? 172.21.15.22:0/1897380487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:12.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:12 smithi084 bash[27323]: cluster 1689214091.2027788 mgr.a (mgr.14152) 1253 : cluster 0 pgmap v1128: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:12.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:12 smithi084 bash[27323]: audit 1689214092.2190688 mon.a (mon.0) 1245 : audit 0 from='client.? 172.21.15.22:0/1897380487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:13.015 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:08:14.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:08:14.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:14 smithi022 bash[26979]: cluster 1689214093.2032602 mgr.a (mgr.14152) 1254 : cluster 0 pgmap v1129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:14.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:14 smithi154 bash[27744]: cluster 1689214093.2032602 mgr.a (mgr.14152) 1254 : cluster 0 pgmap v1129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:14.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:14 smithi137 bash[27262]: cluster 1689214093.2032602 mgr.a (mgr.14152) 1254 : cluster 0 pgmap v1129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:14.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:14 smithi103 bash[27315]: cluster 1689214093.2032602 mgr.a (mgr.14152) 1254 : cluster 0 pgmap v1129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:14.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:14 smithi084 bash[27323]: cluster 1689214093.2032602 mgr.a (mgr.14152) 1254 : cluster 0 pgmap v1129: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:16.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:16 smithi022 bash[26979]: cluster 1689214095.2037268 mgr.a (mgr.14152) 1255 : cluster 0 pgmap v1130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:16.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:16 smithi154 bash[27744]: cluster 1689214095.2037268 mgr.a (mgr.14152) 1255 : cluster 0 pgmap v1130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:16.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:16 smithi137 bash[27262]: cluster 1689214095.2037268 mgr.a (mgr.14152) 1255 : cluster 0 pgmap v1130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:16.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:16 smithi103 bash[27315]: cluster 1689214095.2037268 mgr.a (mgr.14152) 1255 : cluster 0 pgmap v1130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:16.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:16 smithi084 bash[27323]: cluster 1689214095.2037268 mgr.a (mgr.14152) 1255 : cluster 0 pgmap v1130: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:18.711 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:08:18.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:18 smithi022 bash[26979]: cluster 1689214097.2042425 mgr.a (mgr.14152) 1256 : cluster 0 pgmap v1131: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:18.767 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:18 smithi154 bash[27744]: cluster 1689214097.2042425 mgr.a (mgr.14152) 1256 : cluster 0 pgmap v1131: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:18.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:18 smithi137 bash[27262]: cluster 1689214097.2042425 mgr.a (mgr.14152) 1256 : cluster 0 pgmap v1131: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:18.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:18 smithi103 bash[27315]: cluster 1689214097.2042425 mgr.a (mgr.14152) 1256 : cluster 0 pgmap v1131: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:18.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:18 smithi084 bash[27323]: cluster 1689214097.2042425 mgr.a (mgr.14152) 1256 : cluster 0 pgmap v1131: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:20.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:20 smithi022 bash[26979]: cluster 1689214099.204759 mgr.a (mgr.14152) 1257 : cluster 0 pgmap v1132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:20.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:20 smithi154 bash[27744]: cluster 1689214099.204759 mgr.a (mgr.14152) 1257 : cluster 0 pgmap v1132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:20.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:20 smithi137 bash[27262]: cluster 1689214099.204759 mgr.a (mgr.14152) 1257 : cluster 0 pgmap v1132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:20.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:20 smithi103 bash[27315]: cluster 1689214099.204759 mgr.a (mgr.14152) 1257 : cluster 0 pgmap v1132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:20.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:20 smithi084 bash[27323]: cluster 1689214099.204759 mgr.a (mgr.14152) 1257 : cluster 0 pgmap v1132: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:22.152 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:08:22.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:22 smithi022 bash[26979]: cluster 1689214101.205429 mgr.a (mgr.14152) 1258 : cluster 0 pgmap v1133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:22.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:22 smithi022 bash[26979]: audit 1689214102.1507077 mon.b (mon.4) 35 : audit 0 from='client.? 172.21.15.22:0/1631816805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:22.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:22 smithi154 bash[27744]: cluster 1689214101.205429 mgr.a (mgr.14152) 1258 : cluster 0 pgmap v1133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:22.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:22 smithi154 bash[27744]: audit 1689214102.1507077 mon.b (mon.4) 35 : audit 0 from='client.? 172.21.15.22:0/1631816805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:22.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:22 smithi137 bash[27262]: cluster 1689214101.205429 mgr.a (mgr.14152) 1258 : cluster 0 pgmap v1133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:22.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:22 smithi137 bash[27262]: audit 1689214102.1507077 mon.b (mon.4) 35 : audit 0 from='client.? 172.21.15.22:0/1631816805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:22.842 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:08:22.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:22 smithi103 bash[27315]: cluster 1689214101.205429 mgr.a (mgr.14152) 1258 : cluster 0 pgmap v1133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:22.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:22 smithi103 bash[27315]: audit 1689214102.1507077 mon.b (mon.4) 35 : audit 0 from='client.? 172.21.15.22:0/1631816805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:22.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:22 smithi084 bash[27323]: cluster 1689214101.205429 mgr.a (mgr.14152) 1258 : cluster 0 pgmap v1133: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:22.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:22 smithi084 bash[27323]: audit 1689214102.1507077 mon.b (mon.4) 35 : audit 0 from='client.? 172.21.15.22:0/1631816805' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:23.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:08:24.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:24 smithi154 bash[27744]: cluster 1689214103.205976 mgr.a (mgr.14152) 1259 : cluster 0 pgmap v1134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:24.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:24 smithi137 bash[27262]: cluster 1689214103.205976 mgr.a (mgr.14152) 1259 : cluster 0 pgmap v1134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:24.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:24 smithi103 bash[27315]: cluster 1689214103.205976 mgr.a (mgr.14152) 1259 : cluster 0 pgmap v1134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:24.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:24 smithi084 bash[27323]: cluster 1689214103.205976 mgr.a (mgr.14152) 1259 : cluster 0 pgmap v1134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:24.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:24 smithi022 bash[26979]: cluster 1689214103.205976 mgr.a (mgr.14152) 1259 : cluster 0 pgmap v1134: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:26.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:26 smithi154 bash[27744]: cluster 1689214105.2065258 mgr.a (mgr.14152) 1260 : cluster 0 pgmap v1135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:26.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:26 smithi137 bash[27262]: cluster 1689214105.2065258 mgr.a (mgr.14152) 1260 : cluster 0 pgmap v1135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:26.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:26 smithi103 bash[27315]: cluster 1689214105.2065258 mgr.a (mgr.14152) 1260 : cluster 0 pgmap v1135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:26.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:26 smithi084 bash[27323]: cluster 1689214105.2065258 mgr.a (mgr.14152) 1260 : cluster 0 pgmap v1135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:26.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:26 smithi022 bash[26979]: cluster 1689214105.2065258 mgr.a (mgr.14152) 1260 : cluster 0 pgmap v1135: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:08:28.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:28 smithi154 bash[27744]: cluster 1689214107.2070699 mgr.a (mgr.14152) 1261 : cluster 0 pgmap v1136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:28.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:28 smithi137 bash[27262]: cluster 1689214107.2070699 mgr.a (mgr.14152) 1261 : cluster 0 pgmap v1136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:28.864 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:28 smithi103 bash[27315]: cluster 1689214107.2070699 mgr.a (mgr.14152) 1261 : cluster 0 pgmap v1136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:28.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:28 smithi084 bash[27323]: cluster 1689214107.2070699 mgr.a (mgr.14152) 1261 : cluster 0 pgmap v1136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:28.917 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:28 smithi022 bash[26979]: cluster 1689214107.2070699 mgr.a (mgr.14152) 1261 : cluster 0 pgmap v1136: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:30.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:30 smithi154 bash[27744]: cluster 1689214109.2073996 mgr.a (mgr.14152) 1262 : cluster 0 pgmap v1137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:30.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:30 smithi137 bash[27262]: cluster 1689214109.2073996 mgr.a (mgr.14152) 1262 : cluster 0 pgmap v1137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:30.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:30 smithi103 bash[27315]: cluster 1689214109.2073996 mgr.a (mgr.14152) 1262 : cluster 0 pgmap v1137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:30.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:30 smithi084 bash[27323]: cluster 1689214109.2073996 mgr.a (mgr.14152) 1262 : cluster 0 pgmap v1137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:30.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:30 smithi022 bash[26979]: cluster 1689214109.2073996 mgr.a (mgr.14152) 1262 : cluster 0 pgmap v1137: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:31.975 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:08:32.703 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:32 smithi022 bash[26979]: cluster 1689214111.2078578 mgr.a (mgr.14152) 1263 : cluster 0 pgmap v1138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:32.704 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:32 smithi022 bash[26979]: audit 1689214111.973019 mon.d (mon.3) 22 : audit 0 from='client.? 172.21.15.22:0/55009840' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:32.704 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:08:32.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:32 smithi154 bash[27744]: cluster 1689214111.2078578 mgr.a (mgr.14152) 1263 : cluster 0 pgmap v1138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:32.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:32 smithi154 bash[27744]: audit 1689214111.973019 mon.d (mon.3) 22 : audit 0 from='client.? 172.21.15.22:0/55009840' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:32.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:32 smithi137 bash[27262]: cluster 1689214111.2078578 mgr.a (mgr.14152) 1263 : cluster 0 pgmap v1138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:32.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:32 smithi137 bash[27262]: audit 1689214111.973019 mon.d (mon.3) 22 : audit 0 from='client.? 172.21.15.22:0/55009840' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:32.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:32 smithi103 bash[27315]: cluster 1689214111.2078578 mgr.a (mgr.14152) 1263 : cluster 0 pgmap v1138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:32.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:32 smithi103 bash[27315]: audit 1689214111.973019 mon.d (mon.3) 22 : audit 0 from='client.? 172.21.15.22:0/55009840' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:32.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:32 smithi084 bash[27323]: cluster 1689214111.2078578 mgr.a (mgr.14152) 1263 : cluster 0 pgmap v1138: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:32.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:32 smithi084 bash[27323]: audit 1689214111.973019 mon.d (mon.3) 22 : audit 0 from='client.? 172.21.15.22:0/55009840' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:33.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:08:34.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:34 smithi154 bash[27744]: cluster 1689214113.2083695 mgr.a (mgr.14152) 1264 : cluster 0 pgmap v1139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:34.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:34 smithi137 bash[27262]: cluster 1689214113.2083695 mgr.a (mgr.14152) 1264 : cluster 0 pgmap v1139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:34.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:34 smithi103 bash[27315]: cluster 1689214113.2083695 mgr.a (mgr.14152) 1264 : cluster 0 pgmap v1139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:34.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:34 smithi084 bash[27323]: cluster 1689214113.2083695 mgr.a (mgr.14152) 1264 : cluster 0 pgmap v1139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:34.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:34 smithi022 bash[26979]: cluster 1689214113.2083695 mgr.a (mgr.14152) 1264 : cluster 0 pgmap v1139: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:36.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:36 smithi154 bash[27744]: cluster 1689214115.2089834 mgr.a (mgr.14152) 1265 : cluster 0 pgmap v1140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:36.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:36 smithi137 bash[27262]: cluster 1689214115.2089834 mgr.a (mgr.14152) 1265 : cluster 0 pgmap v1140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:36.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:36 smithi103 bash[27315]: cluster 1689214115.2089834 mgr.a (mgr.14152) 1265 : cluster 0 pgmap v1140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:36.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:36 smithi084 bash[27323]: cluster 1689214115.2089834 mgr.a (mgr.14152) 1265 : cluster 0 pgmap v1140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:36.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:36 smithi022 bash[26979]: cluster 1689214115.2089834 mgr.a (mgr.14152) 1265 : cluster 0 pgmap v1140: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:37.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:37 smithi154 bash[27744]: audit 1689214117.3697596 mon.a (mon.0) 1246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:08:37.814 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:37 smithi137 bash[27262]: audit 1689214117.3697596 mon.a (mon.0) 1246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:08:37.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:37 smithi103 bash[27315]: audit 1689214117.3697596 mon.a (mon.0) 1246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:08:37.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:37 smithi084 bash[27323]: audit 1689214117.3697596 mon.a (mon.0) 1246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:08:37.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:37 smithi022 bash[26979]: audit 1689214117.3697596 mon.a (mon.0) 1246 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:08:38.412 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:08:38.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:38 smithi154 bash[27744]: cluster 1689214117.2096207 mgr.a (mgr.14152) 1266 : cluster 0 pgmap v1141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:38.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:38 smithi154 bash[27744]: audit 1689214118.1577358 mon.a (mon.0) 1247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:08:38.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:38 smithi154 bash[27744]: audit 1689214118.1594996 mon.a (mon.0) 1248 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:08:38.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:38 smithi154 bash[27744]: audit 1689214118.1712315 mon.a (mon.0) 1249 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:08:38.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:38 smithi137 bash[27262]: cluster 1689214117.2096207 mgr.a (mgr.14152) 1266 : cluster 0 pgmap v1141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:38.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:38 smithi137 bash[27262]: audit 1689214118.1577358 mon.a (mon.0) 1247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:08:38.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:38 smithi137 bash[27262]: audit 1689214118.1594996 mon.a (mon.0) 1248 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:08:38.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:38 smithi137 bash[27262]: audit 1689214118.1712315 mon.a (mon.0) 1249 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:08:38.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:38 smithi103 bash[27315]: cluster 1689214117.2096207 mgr.a (mgr.14152) 1266 : cluster 0 pgmap v1141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:38.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:38 smithi103 bash[27315]: audit 1689214118.1577358 mon.a (mon.0) 1247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:08:38.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:38 smithi103 bash[27315]: audit 1689214118.1594996 mon.a (mon.0) 1248 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:08:38.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:38 smithi103 bash[27315]: audit 1689214118.1712315 mon.a (mon.0) 1249 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:08:38.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:38 smithi084 bash[27323]: cluster 1689214117.2096207 mgr.a (mgr.14152) 1266 : cluster 0 pgmap v1141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:38.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:38 smithi084 bash[27323]: audit 1689214118.1577358 mon.a (mon.0) 1247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:08:38.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:38 smithi084 bash[27323]: audit 1689214118.1594996 mon.a (mon.0) 1248 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:08:38.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:38 smithi084 bash[27323]: audit 1689214118.1712315 mon.a (mon.0) 1249 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:08:38.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:38 smithi022 bash[26979]: cluster 1689214117.2096207 mgr.a (mgr.14152) 1266 : cluster 0 pgmap v1141: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:38.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:38 smithi022 bash[26979]: audit 1689214118.1577358 mon.a (mon.0) 1247 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:08:38.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:38 smithi022 bash[26979]: audit 1689214118.1594996 mon.a (mon.0) 1248 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:08:38.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:38 smithi022 bash[26979]: audit 1689214118.1712315 mon.a (mon.0) 1249 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:08:39.728 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:39 smithi022 bash[26979]: cluster 1689214118.163043 mgr.a (mgr.14152) 1267 : cluster 0 pgmap v1142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.728 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:39 smithi022 bash[26979]: cluster 1689214118.1634243 mgr.a (mgr.14152) 1268 : cluster 0 pgmap v1143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:39 smithi154 bash[27744]: cluster 1689214118.163043 mgr.a (mgr.14152) 1267 : cluster 0 pgmap v1142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:39 smithi154 bash[27744]: cluster 1689214118.1634243 mgr.a (mgr.14152) 1268 : cluster 0 pgmap v1143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:39 smithi137 bash[27262]: cluster 1689214118.163043 mgr.a (mgr.14152) 1267 : cluster 0 pgmap v1142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:39 smithi137 bash[27262]: cluster 1689214118.1634243 mgr.a (mgr.14152) 1268 : cluster 0 pgmap v1143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:39 smithi103 bash[27315]: cluster 1689214118.163043 mgr.a (mgr.14152) 1267 : cluster 0 pgmap v1142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:39 smithi103 bash[27315]: cluster 1689214118.1634243 mgr.a (mgr.14152) 1268 : cluster 0 pgmap v1143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:39 smithi084 bash[27323]: cluster 1689214118.163043 mgr.a (mgr.14152) 1267 : cluster 0 pgmap v1142: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:39.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:39 smithi084 bash[27323]: cluster 1689214118.1634243 mgr.a (mgr.14152) 1268 : cluster 0 pgmap v1143: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:41.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:41 smithi022 bash[26979]: cluster 1689214120.1638668 mgr.a (mgr.14152) 1269 : cluster 0 pgmap v1144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:41.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:41 smithi154 bash[27744]: cluster 1689214120.1638668 mgr.a (mgr.14152) 1269 : cluster 0 pgmap v1144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:41.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:08:41.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:41 smithi137 bash[27262]: cluster 1689214120.1638668 mgr.a (mgr.14152) 1269 : cluster 0 pgmap v1144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:41.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:41 smithi103 bash[27315]: cluster 1689214120.1638668 mgr.a (mgr.14152) 1269 : cluster 0 pgmap v1144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:41.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:41 smithi084 bash[27323]: cluster 1689214120.1638668 mgr.a (mgr.14152) 1269 : cluster 0 pgmap v1144: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:42.553 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:08:42.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:42 smithi154 bash[27744]: audit 1689214121.7879696 mon.d (mon.3) 23 : audit 0 from='client.? 172.21.15.22:0/2860347735' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:42.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:42 smithi137 bash[27262]: audit 1689214121.7879696 mon.d (mon.3) 23 : audit 0 from='client.? 172.21.15.22:0/2860347735' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:42.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:42 smithi103 bash[27315]: audit 1689214121.7879696 mon.d (mon.3) 23 : audit 0 from='client.? 172.21.15.22:0/2860347735' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:42.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:42 smithi084 bash[27323]: audit 1689214121.7879696 mon.d (mon.3) 23 : audit 0 from='client.? 172.21.15.22:0/2860347735' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:42.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:42 smithi022 bash[26979]: audit 1689214121.7879696 mon.d (mon.3) 23 : audit 0 from='client.? 172.21.15.22:0/2860347735' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:43.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:08:43.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:43 smithi154 bash[27744]: cluster 1689214122.1644483 mgr.a (mgr.14152) 1270 : cluster 0 pgmap v1145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:43.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:43 smithi137 bash[27262]: cluster 1689214122.1644483 mgr.a (mgr.14152) 1270 : cluster 0 pgmap v1145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:43.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:43 smithi103 bash[27315]: cluster 1689214122.1644483 mgr.a (mgr.14152) 1270 : cluster 0 pgmap v1145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:43.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:43 smithi084 bash[27323]: cluster 1689214122.1644483 mgr.a (mgr.14152) 1270 : cluster 0 pgmap v1145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:43.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:43 smithi022 bash[26979]: cluster 1689214122.1644483 mgr.a (mgr.14152) 1270 : cluster 0 pgmap v1145: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:45.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:45 smithi154 bash[27744]: cluster 1689214124.1649961 mgr.a (mgr.14152) 1271 : cluster 0 pgmap v1146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:45.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:45 smithi137 bash[27262]: cluster 1689214124.1649961 mgr.a (mgr.14152) 1271 : cluster 0 pgmap v1146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:45.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:45 smithi103 bash[27315]: cluster 1689214124.1649961 mgr.a (mgr.14152) 1271 : cluster 0 pgmap v1146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:45.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:45 smithi084 bash[27323]: cluster 1689214124.1649961 mgr.a (mgr.14152) 1271 : cluster 0 pgmap v1146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:45.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:45 smithi022 bash[26979]: cluster 1689214124.1649961 mgr.a (mgr.14152) 1271 : cluster 0 pgmap v1146: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:47.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:47 smithi154 bash[27744]: cluster 1689214126.1655107 mgr.a (mgr.14152) 1272 : cluster 0 pgmap v1147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:47.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:47 smithi137 bash[27262]: cluster 1689214126.1655107 mgr.a (mgr.14152) 1272 : cluster 0 pgmap v1147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:47.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:47 smithi103 bash[27315]: cluster 1689214126.1655107 mgr.a (mgr.14152) 1272 : cluster 0 pgmap v1147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:47.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:47 smithi084 bash[27323]: cluster 1689214126.1655107 mgr.a (mgr.14152) 1272 : cluster 0 pgmap v1147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:47.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:47 smithi022 bash[26979]: cluster 1689214126.1655107 mgr.a (mgr.14152) 1272 : cluster 0 pgmap v1147: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:48.257 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:08:49.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:49 smithi154 bash[27744]: cluster 1689214128.1660035 mgr.a (mgr.14152) 1273 : cluster 0 pgmap v1148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:49.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:49 smithi137 bash[27262]: cluster 1689214128.1660035 mgr.a (mgr.14152) 1273 : cluster 0 pgmap v1148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:49.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:49 smithi103 bash[27315]: cluster 1689214128.1660035 mgr.a (mgr.14152) 1273 : cluster 0 pgmap v1148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:49.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:49 smithi084 bash[27323]: cluster 1689214128.1660035 mgr.a (mgr.14152) 1273 : cluster 0 pgmap v1148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:49.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:49 smithi022 bash[26979]: cluster 1689214128.1660035 mgr.a (mgr.14152) 1273 : cluster 0 pgmap v1148: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:51.640 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:08:51.768 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:51 smithi154 bash[27744]: cluster 1689214130.166537 mgr.a (mgr.14152) 1274 : cluster 0 pgmap v1149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:51.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:51 smithi137 bash[27262]: cluster 1689214130.166537 mgr.a (mgr.14152) 1274 : cluster 0 pgmap v1149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:51.839 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:51 smithi022 bash[26979]: cluster 1689214130.166537 mgr.a (mgr.14152) 1274 : cluster 0 pgmap v1149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:51.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:51 smithi103 bash[27315]: cluster 1689214130.166537 mgr.a (mgr.14152) 1274 : cluster 0 pgmap v1149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:51.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:51 smithi084 bash[27323]: cluster 1689214130.166537 mgr.a (mgr.14152) 1274 : cluster 0 pgmap v1149: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:52.381 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:08:52.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:52 smithi022 bash[26979]: audit 1689214131.6370304 mon.a (mon.0) 1250 : audit 0 from='client.? 172.21.15.22:0/2064848065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:52.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:52 smithi137 bash[27262]: audit 1689214131.6370304 mon.a (mon.0) 1250 : audit 0 from='client.? 172.21.15.22:0/2064848065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:52.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:52 smithi103 bash[27315]: audit 1689214131.6370304 mon.a (mon.0) 1250 : audit 0 from='client.? 172.21.15.22:0/2064848065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:52.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:52 smithi084 bash[27323]: audit 1689214131.6370304 mon.a (mon.0) 1250 : audit 0 from='client.? 172.21.15.22:0/2064848065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:53.018 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:52 smithi154 bash[27744]: audit 1689214131.6370304 mon.a (mon.0) 1250 : audit 0 from='client.? 172.21.15.22:0/2064848065' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:08:53.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:08:53.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:53 smithi022 bash[26979]: cluster 1689214132.1671271 mgr.a (mgr.14152) 1275 : cluster 0 pgmap v1150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:53.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:53 smithi137 bash[27262]: cluster 1689214132.1671271 mgr.a (mgr.14152) 1275 : cluster 0 pgmap v1150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:53.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:53 smithi103 bash[27315]: cluster 1689214132.1671271 mgr.a (mgr.14152) 1275 : cluster 0 pgmap v1150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:53.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:53 smithi084 bash[27323]: cluster 1689214132.1671271 mgr.a (mgr.14152) 1275 : cluster 0 pgmap v1150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:54.018 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:53 smithi154 bash[27744]: cluster 1689214132.1671271 mgr.a (mgr.14152) 1275 : cluster 0 pgmap v1150: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:54.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:54 smithi137 bash[27262]: cluster 1689214134.1676571 mgr.a (mgr.14152) 1276 : cluster 0 pgmap v1151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:54.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:54 smithi103 bash[27315]: cluster 1689214134.1676571 mgr.a (mgr.14152) 1276 : cluster 0 pgmap v1151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:54.903 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:54 smithi084 bash[27323]: cluster 1689214134.1676571 mgr.a (mgr.14152) 1276 : cluster 0 pgmap v1151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:54.918 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:54 smithi022 bash[26979]: cluster 1689214134.1676571 mgr.a (mgr.14152) 1276 : cluster 0 pgmap v1151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:55.019 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:54 smithi154 bash[27744]: cluster 1689214134.1676571 mgr.a (mgr.14152) 1276 : cluster 0 pgmap v1151: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:57.654 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:57 smithi084 bash[27323]: cluster 1689214136.1681929 mgr.a (mgr.14152) 1277 : cluster 0 pgmap v1152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:57.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:57 smithi022 bash[26979]: cluster 1689214136.1681929 mgr.a (mgr.14152) 1277 : cluster 0 pgmap v1152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:57.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:57 smithi154 bash[27744]: cluster 1689214136.1681929 mgr.a (mgr.14152) 1277 : cluster 0 pgmap v1152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:57.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:57 smithi137 bash[27262]: cluster 1689214136.1681929 mgr.a (mgr.14152) 1277 : cluster 0 pgmap v1152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:57.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:57 smithi103 bash[27315]: cluster 1689214136.1681929 mgr.a (mgr.14152) 1277 : cluster 0 pgmap v1152: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:58.071 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:08:59.654 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:08:59 smithi084 bash[27323]: cluster 1689214138.1687713 mgr.a (mgr.14152) 1278 : cluster 0 pgmap v1153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:59.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:08:59 smithi022 bash[26979]: cluster 1689214138.1687713 mgr.a (mgr.14152) 1278 : cluster 0 pgmap v1153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:59.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:08:59 smithi154 bash[27744]: cluster 1689214138.1687713 mgr.a (mgr.14152) 1278 : cluster 0 pgmap v1153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:59.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:08:59 smithi137 bash[27262]: cluster 1689214138.1687713 mgr.a (mgr.14152) 1278 : cluster 0 pgmap v1153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:08:59.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:08:59 smithi103 bash[27315]: cluster 1689214138.1687713 mgr.a (mgr.14152) 1278 : cluster 0 pgmap v1153: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:01.390 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:09:01.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:01 smithi022 bash[26979]: cluster 1689214140.1693773 mgr.a (mgr.14152) 1279 : cluster 0 pgmap v1154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:01.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:01 smithi022 bash[26979]: audit 1689214141.386731 mon.a (mon.0) 1251 : audit 0 from='client.? 172.21.15.22:0/785378646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:01.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:01 smithi154 bash[27744]: cluster 1689214140.1693773 mgr.a (mgr.14152) 1279 : cluster 0 pgmap v1154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:01.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:01 smithi154 bash[27744]: audit 1689214141.386731 mon.a (mon.0) 1251 : audit 0 from='client.? 172.21.15.22:0/785378646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:01.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:01 smithi137 bash[27262]: cluster 1689214140.1693773 mgr.a (mgr.14152) 1279 : cluster 0 pgmap v1154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:01.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:01 smithi137 bash[27262]: audit 1689214141.386731 mon.a (mon.0) 1251 : audit 0 from='client.? 172.21.15.22:0/785378646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:01.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:01 smithi103 bash[27315]: cluster 1689214140.1693773 mgr.a (mgr.14152) 1279 : cluster 0 pgmap v1154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:01.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:01 smithi103 bash[27315]: audit 1689214141.386731 mon.a (mon.0) 1251 : audit 0 from='client.? 172.21.15.22:0/785378646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:01.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:01 smithi084 bash[27323]: cluster 1689214140.1693773 mgr.a (mgr.14152) 1279 : cluster 0 pgmap v1154: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:01.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:01 smithi084 bash[27323]: audit 1689214141.386731 mon.a (mon.0) 1251 : audit 0 from='client.? 172.21.15.22:0/785378646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:02.123 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:09:03.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:09:03.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:03 smithi022 bash[26979]: cluster 1689214142.1699178 mgr.a (mgr.14152) 1280 : cluster 0 pgmap v1155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:03.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:03 smithi154 bash[27744]: cluster 1689214142.1699178 mgr.a (mgr.14152) 1280 : cluster 0 pgmap v1155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:03.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:03 smithi137 bash[27262]: cluster 1689214142.1699178 mgr.a (mgr.14152) 1280 : cluster 0 pgmap v1155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:03.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:03 smithi103 bash[27315]: cluster 1689214142.1699178 mgr.a (mgr.14152) 1280 : cluster 0 pgmap v1155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:03.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:03 smithi084 bash[27323]: cluster 1689214142.1699178 mgr.a (mgr.14152) 1280 : cluster 0 pgmap v1155: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:05 smithi022 bash[26979]: cluster 1689214144.17042 mgr.a (mgr.14152) 1281 : cluster 0 pgmap v1156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:05.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:05 smithi154 bash[27744]: cluster 1689214144.17042 mgr.a (mgr.14152) 1281 : cluster 0 pgmap v1156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:05.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:05 smithi137 bash[27262]: cluster 1689214144.17042 mgr.a (mgr.14152) 1281 : cluster 0 pgmap v1156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:05.865 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:05 smithi103 bash[27315]: cluster 1689214144.17042 mgr.a (mgr.14152) 1281 : cluster 0 pgmap v1156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:05.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:05 smithi084 bash[27323]: cluster 1689214144.17042 mgr.a (mgr.14152) 1281 : cluster 0 pgmap v1156: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:07.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:07 smithi022 bash[26979]: cluster 1689214146.1709645 mgr.a (mgr.14152) 1282 : cluster 0 pgmap v1157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:07.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:07 smithi154 bash[27744]: cluster 1689214146.1709645 mgr.a (mgr.14152) 1282 : cluster 0 pgmap v1157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:07.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:07 smithi137 bash[27262]: cluster 1689214146.1709645 mgr.a (mgr.14152) 1282 : cluster 0 pgmap v1157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:07.819 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:09:07.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:07 smithi103 bash[27315]: cluster 1689214146.1709645 mgr.a (mgr.14152) 1282 : cluster 0 pgmap v1157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:07.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:07 smithi084 bash[27323]: cluster 1689214146.1709645 mgr.a (mgr.14152) 1282 : cluster 0 pgmap v1157: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:09.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:09 smithi022 bash[26979]: cluster 1689214148.1714952 mgr.a (mgr.14152) 1283 : cluster 0 pgmap v1158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:09.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:09 smithi154 bash[27744]: cluster 1689214148.1714952 mgr.a (mgr.14152) 1283 : cluster 0 pgmap v1158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:09.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:09 smithi137 bash[27262]: cluster 1689214148.1714952 mgr.a (mgr.14152) 1283 : cluster 0 pgmap v1158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:09.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:09 smithi103 bash[27315]: cluster 1689214148.1714952 mgr.a (mgr.14152) 1283 : cluster 0 pgmap v1158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:09.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:09 smithi084 bash[27323]: cluster 1689214148.1714952 mgr.a (mgr.14152) 1283 : cluster 0 pgmap v1158: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:11.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:09:11.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:11 smithi022 bash[26979]: cluster 1689214150.1720223 mgr.a (mgr.14152) 1284 : cluster 0 pgmap v1159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:11.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:11 smithi022 bash[26979]: audit 1689214151.318413 mon.a (mon.0) 1252 : audit 0 from='client.? 172.21.15.22:0/867256806' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:11.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:11 smithi154 bash[27744]: cluster 1689214150.1720223 mgr.a (mgr.14152) 1284 : cluster 0 pgmap v1159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:11.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:11 smithi154 bash[27744]: audit 1689214151.318413 mon.a (mon.0) 1252 : audit 0 from='client.? 172.21.15.22:0/867256806' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:11.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:11 smithi137 bash[27262]: cluster 1689214150.1720223 mgr.a (mgr.14152) 1284 : cluster 0 pgmap v1159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:11.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:11 smithi137 bash[27262]: audit 1689214151.318413 mon.a (mon.0) 1252 : audit 0 from='client.? 172.21.15.22:0/867256806' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:11.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:11 smithi103 bash[27315]: cluster 1689214150.1720223 mgr.a (mgr.14152) 1284 : cluster 0 pgmap v1159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:11.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:11 smithi103 bash[27315]: audit 1689214151.318413 mon.a (mon.0) 1252 : audit 0 from='client.? 172.21.15.22:0/867256806' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:11.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:11 smithi084 bash[27323]: cluster 1689214150.1720223 mgr.a (mgr.14152) 1284 : cluster 0 pgmap v1159: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:11.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:11 smithi084 bash[27323]: audit 1689214151.318413 mon.a (mon.0) 1252 : audit 0 from='client.? 172.21.15.22:0/867256806' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:12.089 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:09:13.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:09:13.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:13 smithi154 bash[27744]: cluster 1689214152.17257 mgr.a (mgr.14152) 1285 : cluster 0 pgmap v1160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:13.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:13 smithi137 bash[27262]: cluster 1689214152.17257 mgr.a (mgr.14152) 1285 : cluster 0 pgmap v1160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:13.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:13 smithi103 bash[27315]: cluster 1689214152.17257 mgr.a (mgr.14152) 1285 : cluster 0 pgmap v1160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:13.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:13 smithi084 bash[27323]: cluster 1689214152.17257 mgr.a (mgr.14152) 1285 : cluster 0 pgmap v1160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:13.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:13 smithi022 bash[26979]: cluster 1689214152.17257 mgr.a (mgr.14152) 1285 : cluster 0 pgmap v1160: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:15.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:15 smithi154 bash[27744]: cluster 1689214154.1730974 mgr.a (mgr.14152) 1286 : cluster 0 pgmap v1161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:15.815 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:15 smithi137 bash[27262]: cluster 1689214154.1730974 mgr.a (mgr.14152) 1286 : cluster 0 pgmap v1161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:15.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:15 smithi103 bash[27315]: cluster 1689214154.1730974 mgr.a (mgr.14152) 1286 : cluster 0 pgmap v1161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:15.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:15 smithi084 bash[27323]: cluster 1689214154.1730974 mgr.a (mgr.14152) 1286 : cluster 0 pgmap v1161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:15.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:15 smithi022 bash[26979]: cluster 1689214154.1730974 mgr.a (mgr.14152) 1286 : cluster 0 pgmap v1161: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:17.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:17 smithi154 bash[27744]: cluster 1689214156.1736333 mgr.a (mgr.14152) 1287 : cluster 0 pgmap v1162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:17.785 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:09:17.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:17 smithi137 bash[27262]: cluster 1689214156.1736333 mgr.a (mgr.14152) 1287 : cluster 0 pgmap v1162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:17.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:17 smithi022 bash[26979]: cluster 1689214156.1736333 mgr.a (mgr.14152) 1287 : cluster 0 pgmap v1162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:17.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:17 smithi103 bash[27315]: cluster 1689214156.1736333 mgr.a (mgr.14152) 1287 : cluster 0 pgmap v1162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:17.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:17 smithi084 bash[27323]: cluster 1689214156.1736333 mgr.a (mgr.14152) 1287 : cluster 0 pgmap v1162: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:19.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:19 smithi022 bash[26979]: cluster 1689214158.1741786 mgr.a (mgr.14152) 1288 : cluster 0 pgmap v1163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:19.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:19 smithi154 bash[27744]: cluster 1689214158.1741786 mgr.a (mgr.14152) 1288 : cluster 0 pgmap v1163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:19.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:19 smithi137 bash[27262]: cluster 1689214158.1741786 mgr.a (mgr.14152) 1288 : cluster 0 pgmap v1163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:19.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:19 smithi103 bash[27315]: cluster 1689214158.1741786 mgr.a (mgr.14152) 1288 : cluster 0 pgmap v1163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:19.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:19 smithi084 bash[27323]: cluster 1689214158.1741786 mgr.a (mgr.14152) 1288 : cluster 0 pgmap v1163: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:21.206 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:09:21.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:21 smithi022 bash[26979]: cluster 1689214160.1747267 mgr.a (mgr.14152) 1289 : cluster 0 pgmap v1164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:21.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:21 smithi022 bash[26979]: audit 1689214161.2026477 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.22:0/510119004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:21.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:21 smithi154 bash[27744]: cluster 1689214160.1747267 mgr.a (mgr.14152) 1289 : cluster 0 pgmap v1164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:21.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:21 smithi154 bash[27744]: audit 1689214161.2026477 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.22:0/510119004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:21.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:21 smithi137 bash[27262]: cluster 1689214160.1747267 mgr.a (mgr.14152) 1289 : cluster 0 pgmap v1164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:21.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:21 smithi137 bash[27262]: audit 1689214161.2026477 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.22:0/510119004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:21.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:21 smithi103 bash[27315]: cluster 1689214160.1747267 mgr.a (mgr.14152) 1289 : cluster 0 pgmap v1164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:21.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:21 smithi103 bash[27315]: audit 1689214161.2026477 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.22:0/510119004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:21.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:21 smithi084 bash[27323]: cluster 1689214160.1747267 mgr.a (mgr.14152) 1289 : cluster 0 pgmap v1164: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:21.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:21 smithi084 bash[27323]: audit 1689214161.2026477 mon.a (mon.0) 1253 : audit 0 from='client.? 172.21.15.22:0/510119004' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:21.954 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:09:22.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:09:23.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:23 smithi154 bash[27744]: cluster 1689214162.1752677 mgr.a (mgr.14152) 1290 : cluster 0 pgmap v1165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:23.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:23 smithi137 bash[27262]: cluster 1689214162.1752677 mgr.a (mgr.14152) 1290 : cluster 0 pgmap v1165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:23.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:23 smithi103 bash[27315]: cluster 1689214162.1752677 mgr.a (mgr.14152) 1290 : cluster 0 pgmap v1165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:23.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:23 smithi084 bash[27323]: cluster 1689214162.1752677 mgr.a (mgr.14152) 1290 : cluster 0 pgmap v1165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:23.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:23 smithi022 bash[26979]: cluster 1689214162.1752677 mgr.a (mgr.14152) 1290 : cluster 0 pgmap v1165: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:25.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:25 smithi154 bash[27744]: cluster 1689214164.1758108 mgr.a (mgr.14152) 1291 : cluster 0 pgmap v1166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:25.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:25 smithi137 bash[27262]: cluster 1689214164.1758108 mgr.a (mgr.14152) 1291 : cluster 0 pgmap v1166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:25.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:25 smithi103 bash[27315]: cluster 1689214164.1758108 mgr.a (mgr.14152) 1291 : cluster 0 pgmap v1166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:25.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:25 smithi084 bash[27323]: cluster 1689214164.1758108 mgr.a (mgr.14152) 1291 : cluster 0 pgmap v1166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:25.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:25 smithi022 bash[26979]: cluster 1689214164.1758108 mgr.a (mgr.14152) 1291 : cluster 0 pgmap v1166: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:27.648 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:09:27.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:27 smithi154 bash[27744]: cluster 1689214166.17634 mgr.a (mgr.14152) 1292 : cluster 0 pgmap v1167: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:27.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:27 smithi137 bash[27262]: cluster 1689214166.17634 mgr.a (mgr.14152) 1292 : cluster 0 pgmap v1167: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:27.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:27 smithi103 bash[27315]: cluster 1689214166.17634 mgr.a (mgr.14152) 1292 : cluster 0 pgmap v1167: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:27.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:27 smithi084 bash[27323]: cluster 1689214166.17634 mgr.a (mgr.14152) 1292 : cluster 0 pgmap v1167: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:27.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:27 smithi022 bash[26979]: cluster 1689214166.17634 mgr.a (mgr.14152) 1292 : cluster 0 pgmap v1167: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:29.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:29 smithi154 bash[27744]: cluster 1689214168.176787 mgr.a (mgr.14152) 1293 : cluster 0 pgmap v1168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:29.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:29 smithi137 bash[27262]: cluster 1689214168.176787 mgr.a (mgr.14152) 1293 : cluster 0 pgmap v1168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:29.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:29 smithi103 bash[27315]: cluster 1689214168.176787 mgr.a (mgr.14152) 1293 : cluster 0 pgmap v1168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:29.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:29 smithi084 bash[27323]: cluster 1689214168.176787 mgr.a (mgr.14152) 1293 : cluster 0 pgmap v1168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:29.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:29 smithi022 bash[26979]: cluster 1689214168.176787 mgr.a (mgr.14152) 1293 : cluster 0 pgmap v1168: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:30.986 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:09:31.714 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:09:31.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:31 smithi154 bash[27744]: cluster 1689214170.1772888 mgr.a (mgr.14152) 1294 : cluster 0 pgmap v1169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:31.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:31 smithi154 bash[27744]: audit 1689214170.9819627 mon.a (mon.0) 1254 : audit 0 from='client.? 172.21.15.22:0/3661495475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:31.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:31 smithi137 bash[27262]: cluster 1689214170.1772888 mgr.a (mgr.14152) 1294 : cluster 0 pgmap v1169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:31.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:31 smithi137 bash[27262]: audit 1689214170.9819627 mon.a (mon.0) 1254 : audit 0 from='client.? 172.21.15.22:0/3661495475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:31.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:31 smithi103 bash[27315]: cluster 1689214170.1772888 mgr.a (mgr.14152) 1294 : cluster 0 pgmap v1169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:31.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:31 smithi103 bash[27315]: audit 1689214170.9819627 mon.a (mon.0) 1254 : audit 0 from='client.? 172.21.15.22:0/3661495475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:31.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:31 smithi084 bash[27323]: cluster 1689214170.1772888 mgr.a (mgr.14152) 1294 : cluster 0 pgmap v1169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:31.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:31 smithi084 bash[27323]: audit 1689214170.9819627 mon.a (mon.0) 1254 : audit 0 from='client.? 172.21.15.22:0/3661495475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:31.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:31 smithi022 bash[26979]: cluster 1689214170.1772888 mgr.a (mgr.14152) 1294 : cluster 0 pgmap v1169: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:31.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:31 smithi022 bash[26979]: audit 1689214170.9819627 mon.a (mon.0) 1254 : audit 0 from='client.? 172.21.15.22:0/3661495475' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:32.715 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:09:33.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:33 smithi154 bash[27744]: cluster 1689214172.177803 mgr.a (mgr.14152) 1295 : cluster 0 pgmap v1170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:33.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:33 smithi137 bash[27262]: cluster 1689214172.177803 mgr.a (mgr.14152) 1295 : cluster 0 pgmap v1170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:33.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:33 smithi103 bash[27315]: cluster 1689214172.177803 mgr.a (mgr.14152) 1295 : cluster 0 pgmap v1170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:33.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:33 smithi084 bash[27323]: cluster 1689214172.177803 mgr.a (mgr.14152) 1295 : cluster 0 pgmap v1170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:33.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:33 smithi022 bash[26979]: cluster 1689214172.177803 mgr.a (mgr.14152) 1295 : cluster 0 pgmap v1170: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:35.769 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:35 smithi154 bash[27744]: cluster 1689214174.1783412 mgr.a (mgr.14152) 1296 : cluster 0 pgmap v1171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:35.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:35 smithi137 bash[27262]: cluster 1689214174.1783412 mgr.a (mgr.14152) 1296 : cluster 0 pgmap v1171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:35.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:35 smithi103 bash[27315]: cluster 1689214174.1783412 mgr.a (mgr.14152) 1296 : cluster 0 pgmap v1171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:35.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:35 smithi084 bash[27323]: cluster 1689214174.1783412 mgr.a (mgr.14152) 1296 : cluster 0 pgmap v1171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:35.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:35 smithi022 bash[26979]: cluster 1689214174.1783412 mgr.a (mgr.14152) 1296 : cluster 0 pgmap v1171: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:37.412 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:09:37.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:37 smithi154 bash[27744]: cluster 1689214176.178873 mgr.a (mgr.14152) 1297 : cluster 0 pgmap v1172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:37.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:37 smithi137 bash[27262]: cluster 1689214176.178873 mgr.a (mgr.14152) 1297 : cluster 0 pgmap v1172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:37.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:37 smithi103 bash[27315]: cluster 1689214176.178873 mgr.a (mgr.14152) 1297 : cluster 0 pgmap v1172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:37.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:37 smithi084 bash[27323]: cluster 1689214176.178873 mgr.a (mgr.14152) 1297 : cluster 0 pgmap v1172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:37.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:37 smithi022 bash[26979]: cluster 1689214176.178873 mgr.a (mgr.14152) 1297 : cluster 0 pgmap v1172: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:38.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:38 smithi154 bash[27744]: audit 1689214178.3382459 mon.a (mon.0) 1255 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:09:38.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:38 smithi137 bash[27262]: audit 1689214178.3382459 mon.a (mon.0) 1255 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:09:38.840 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:38 smithi022 bash[26979]: audit 1689214178.3382459 mon.a (mon.0) 1255 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:09:38.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:38 smithi103 bash[27315]: audit 1689214178.3382459 mon.a (mon.0) 1255 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:09:38.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:38 smithi084 bash[27323]: audit 1689214178.3382459 mon.a (mon.0) 1255 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:09:39.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:39 smithi022 bash[26979]: cluster 1689214178.1793702 mgr.a (mgr.14152) 1298 : cluster 0 pgmap v1173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:39.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:39 smithi154 bash[27744]: cluster 1689214178.1793702 mgr.a (mgr.14152) 1298 : cluster 0 pgmap v1173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:39.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:39 smithi137 bash[27262]: cluster 1689214178.1793702 mgr.a (mgr.14152) 1298 : cluster 0 pgmap v1173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:39.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:39 smithi103 bash[27315]: cluster 1689214178.1793702 mgr.a (mgr.14152) 1298 : cluster 0 pgmap v1173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:39.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:39 smithi084 bash[27323]: cluster 1689214178.1793702 mgr.a (mgr.14152) 1298 : cluster 0 pgmap v1173: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:09:41.568 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:09:41.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:41 smithi154 bash[27744]: cluster 1689214180.1798468 mgr.a (mgr.14152) 1299 : cluster 0 pgmap v1174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:41.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:41 smithi154 bash[27744]: audit 1689214180.7847192 mon.a (mon.0) 1256 : audit 0 from='client.? 172.21.15.22:0/2116557369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:41.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:41 smithi137 bash[27262]: cluster 1689214180.1798468 mgr.a (mgr.14152) 1299 : cluster 0 pgmap v1174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:41.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:41 smithi137 bash[27262]: audit 1689214180.7847192 mon.a (mon.0) 1256 : audit 0 from='client.? 172.21.15.22:0/2116557369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:41.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:41 smithi103 bash[27315]: cluster 1689214180.1798468 mgr.a (mgr.14152) 1299 : cluster 0 pgmap v1174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:41.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:41 smithi103 bash[27315]: audit 1689214180.7847192 mon.a (mon.0) 1256 : audit 0 from='client.? 172.21.15.22:0/2116557369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:41.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:41 smithi084 bash[27323]: cluster 1689214180.1798468 mgr.a (mgr.14152) 1299 : cluster 0 pgmap v1174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:41.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:41 smithi084 bash[27323]: audit 1689214180.7847192 mon.a (mon.0) 1256 : audit 0 from='client.? 172.21.15.22:0/2116557369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:41.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:41 smithi022 bash[26979]: cluster 1689214180.1798468 mgr.a (mgr.14152) 1299 : cluster 0 pgmap v1174: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:41.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:41 smithi022 bash[26979]: audit 1689214180.7847192 mon.a (mon.0) 1256 : audit 0 from='client.? 172.21.15.22:0/2116557369' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:42.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:09:43.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:43 smithi154 bash[27744]: cluster 1689214182.1803625 mgr.a (mgr.14152) 1300 : cluster 0 pgmap v1175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:43.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:43 smithi137 bash[27262]: cluster 1689214182.1803625 mgr.a (mgr.14152) 1300 : cluster 0 pgmap v1175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:43.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:43 smithi103 bash[27315]: cluster 1689214182.1803625 mgr.a (mgr.14152) 1300 : cluster 0 pgmap v1175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:43.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:43 smithi084 bash[27323]: cluster 1689214182.1803625 mgr.a (mgr.14152) 1300 : cluster 0 pgmap v1175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:43.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:43 smithi022 bash[26979]: cluster 1689214182.1803625 mgr.a (mgr.14152) 1300 : cluster 0 pgmap v1175: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:45.155 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: audit 1689214183.898327 mon.a (mon.0) 1257 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: audit 1689214183.9060628 mon.a (mon.0) 1258 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: cluster 1689214184.1808088 mgr.a (mgr.14152) 1301 : cluster 0 pgmap v1176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:45.156 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: audit 1689214184.3800285 mon.a (mon.0) 1259 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: audit 1689214184.3816683 mon.a (mon.0) 1260 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: audit 1689214184.383099 mon.a (mon.0) 1261 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.157 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:44 smithi084 bash[27323]: cephadm 1689214184.3842194 mgr.a (mgr.14152) 1302 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T02:09:45.169 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: audit 1689214183.898327 mon.a (mon.0) 1257 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: audit 1689214183.9060628 mon.a (mon.0) 1258 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: cluster 1689214184.1808088 mgr.a (mgr.14152) 1301 : cluster 0 pgmap v1176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:45.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: audit 1689214184.3800285 mon.a (mon.0) 1259 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: audit 1689214184.3816683 mon.a (mon.0) 1260 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: audit 1689214184.383099 mon.a (mon.0) 1261 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:44 smithi022 bash[26979]: cephadm 1689214184.3842194 mgr.a (mgr.14152) 1302 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T02:09:45.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: audit 1689214183.898327 mon.a (mon.0) 1257 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: audit 1689214183.9060628 mon.a (mon.0) 1258 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.270 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: cluster 1689214184.1808088 mgr.a (mgr.14152) 1301 : cluster 0 pgmap v1176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:45.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: audit 1689214184.3800285 mon.a (mon.0) 1259 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: audit 1689214184.3816683 mon.a (mon.0) 1260 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: audit 1689214184.383099 mon.a (mon.0) 1261 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:44 smithi154 bash[27744]: cephadm 1689214184.3842194 mgr.a (mgr.14152) 1302 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T02:09:45.316 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: audit 1689214183.898327 mon.a (mon.0) 1257 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: audit 1689214183.9060628 mon.a (mon.0) 1258 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: cluster 1689214184.1808088 mgr.a (mgr.14152) 1301 : cluster 0 pgmap v1176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:45.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: audit 1689214184.3800285 mon.a (mon.0) 1259 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: audit 1689214184.3816683 mon.a (mon.0) 1260 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: audit 1689214184.383099 mon.a (mon.0) 1261 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:44 smithi137 bash[27262]: cephadm 1689214184.3842194 mgr.a (mgr.14152) 1302 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T02:09:45.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: audit 1689214183.898327 mon.a (mon.0) 1257 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: audit 1689214183.9060628 mon.a (mon.0) 1258 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:45.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: cluster 1689214184.1808088 mgr.a (mgr.14152) 1301 : cluster 0 pgmap v1176: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:45.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: audit 1689214184.3800285 mon.a (mon.0) 1259 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: audit 1689214184.3816683 mon.a (mon.0) 1260 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.367 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: audit 1689214184.383099 mon.a (mon.0) 1261 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:09:45.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:44 smithi103 bash[27315]: cephadm 1689214184.3842194 mgr.a (mgr.14152) 1302 : cephadm 1 Adjusting osd_memory_target on smithi137 to 5755M 2023-07-13T02:09:47.082 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:09:47.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:47 smithi154 bash[27744]: cluster 1689214186.181313 mgr.a (mgr.14152) 1303 : cluster 0 pgmap v1177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:47.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:47 smithi022 bash[26979]: cluster 1689214186.181313 mgr.a (mgr.14152) 1303 : cluster 0 pgmap v1177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:47.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:47 smithi137 bash[27262]: cluster 1689214186.181313 mgr.a (mgr.14152) 1303 : cluster 0 pgmap v1177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:47.866 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:47 smithi103 bash[27315]: cluster 1689214186.181313 mgr.a (mgr.14152) 1303 : cluster 0 pgmap v1177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:47.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:47 smithi084 bash[27323]: cluster 1689214186.181313 mgr.a (mgr.14152) 1303 : cluster 0 pgmap v1177: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:49.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:49 smithi022 bash[26979]: cluster 1689214188.1819386 mgr.a (mgr.14152) 1304 : cluster 0 pgmap v1178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:49.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:49 smithi022 bash[26979]: audit 1689214188.8294702 mon.a (mon.0) 1262 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:49 smithi022 bash[26979]: audit 1689214188.8373613 mon.a (mon.0) 1263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:49 smithi022 bash[26979]: audit 1689214188.838609 mon.a (mon.0) 1264 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:09:49.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:49 smithi022 bash[26979]: audit 1689214188.8398836 mon.a (mon.0) 1265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:09:49.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:49 smithi022 bash[26979]: audit 1689214188.8487391 mon.a (mon.0) 1266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:49 smithi154 bash[27744]: cluster 1689214188.1819386 mgr.a (mgr.14152) 1304 : cluster 0 pgmap v1178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:49.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:49 smithi154 bash[27744]: audit 1689214188.8294702 mon.a (mon.0) 1262 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:49 smithi154 bash[27744]: audit 1689214188.8373613 mon.a (mon.0) 1263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:49 smithi154 bash[27744]: audit 1689214188.838609 mon.a (mon.0) 1264 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:09:49.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:49 smithi154 bash[27744]: audit 1689214188.8398836 mon.a (mon.0) 1265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:09:49.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:49 smithi154 bash[27744]: audit 1689214188.8487391 mon.a (mon.0) 1266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:49 smithi137 bash[27262]: cluster 1689214188.1819386 mgr.a (mgr.14152) 1304 : cluster 0 pgmap v1178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:49.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:49 smithi137 bash[27262]: audit 1689214188.8294702 mon.a (mon.0) 1262 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:49 smithi137 bash[27262]: audit 1689214188.8373613 mon.a (mon.0) 1263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:49 smithi137 bash[27262]: audit 1689214188.838609 mon.a (mon.0) 1264 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:09:49.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:49 smithi137 bash[27262]: audit 1689214188.8398836 mon.a (mon.0) 1265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:09:49.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:49 smithi137 bash[27262]: audit 1689214188.8487391 mon.a (mon.0) 1266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:49 smithi103 bash[27315]: cluster 1689214188.1819386 mgr.a (mgr.14152) 1304 : cluster 0 pgmap v1178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:49.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:49 smithi103 bash[27315]: audit 1689214188.8294702 mon.a (mon.0) 1262 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:49 smithi103 bash[27315]: audit 1689214188.8373613 mon.a (mon.0) 1263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:49 smithi103 bash[27315]: audit 1689214188.838609 mon.a (mon.0) 1264 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:09:49.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:49 smithi103 bash[27315]: audit 1689214188.8398836 mon.a (mon.0) 1265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:09:49.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:49 smithi103 bash[27315]: audit 1689214188.8487391 mon.a (mon.0) 1266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:49 smithi084 bash[27323]: cluster 1689214188.1819386 mgr.a (mgr.14152) 1304 : cluster 0 pgmap v1178: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:49.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:49 smithi084 bash[27323]: audit 1689214188.8294702 mon.a (mon.0) 1262 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:49 smithi084 bash[27323]: audit 1689214188.8373613 mon.a (mon.0) 1263 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:49.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:49 smithi084 bash[27323]: audit 1689214188.838609 mon.a (mon.0) 1264 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:09:49.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:49 smithi084 bash[27323]: audit 1689214188.8398836 mon.a (mon.0) 1265 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:09:49.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:49 smithi084 bash[27323]: audit 1689214188.8487391 mon.a (mon.0) 1266 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:09:50.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:50 smithi022 bash[26979]: cluster 1689214188.842299 mgr.a (mgr.14152) 1305 : cluster 0 pgmap v1179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.728 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:50 smithi022 bash[26979]: cluster 1689214188.842561 mgr.a (mgr.14152) 1306 : cluster 0 pgmap v1180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:50 smithi154 bash[27744]: cluster 1689214188.842299 mgr.a (mgr.14152) 1305 : cluster 0 pgmap v1179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:50 smithi154 bash[27744]: cluster 1689214188.842561 mgr.a (mgr.14152) 1306 : cluster 0 pgmap v1180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:50 smithi137 bash[27262]: cluster 1689214188.842299 mgr.a (mgr.14152) 1305 : cluster 0 pgmap v1179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:50 smithi137 bash[27262]: cluster 1689214188.842561 mgr.a (mgr.14152) 1306 : cluster 0 pgmap v1180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:50 smithi103 bash[27315]: cluster 1689214188.842299 mgr.a (mgr.14152) 1305 : cluster 0 pgmap v1179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:50 smithi103 bash[27315]: cluster 1689214188.842561 mgr.a (mgr.14152) 1306 : cluster 0 pgmap v1180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:50 smithi084 bash[27323]: cluster 1689214188.842299 mgr.a (mgr.14152) 1305 : cluster 0 pgmap v1179: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:50.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:50 smithi084 bash[27323]: cluster 1689214188.842561 mgr.a (mgr.14152) 1306 : cluster 0 pgmap v1180: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:51.192 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:09:51.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:51 smithi022 bash[26979]: audit 1689214191.186164 mon.a (mon.0) 1267 : audit 0 from='client.? 172.21.15.22:0/327391107' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:51.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:51 smithi154 bash[27744]: audit 1689214191.186164 mon.a (mon.0) 1267 : audit 0 from='client.? 172.21.15.22:0/327391107' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:51.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:51 smithi137 bash[27262]: audit 1689214191.186164 mon.a (mon.0) 1267 : audit 0 from='client.? 172.21.15.22:0/327391107' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:51.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:51 smithi103 bash[27315]: audit 1689214191.186164 mon.a (mon.0) 1267 : audit 0 from='client.? 172.21.15.22:0/327391107' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:51.891 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:09:51.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:51 smithi084 bash[27323]: audit 1689214191.186164 mon.a (mon.0) 1267 : audit 0 from='client.? 172.21.15.22:0/327391107' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:09:52.773 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:52 smithi154 bash[27744]: cluster 1689214190.8429217 mgr.a (mgr.14152) 1307 : cluster 0 pgmap v1181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:52.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:52 smithi137 bash[27262]: cluster 1689214190.8429217 mgr.a (mgr.14152) 1307 : cluster 0 pgmap v1181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:52.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:52 smithi103 bash[27315]: cluster 1689214190.8429217 mgr.a (mgr.14152) 1307 : cluster 0 pgmap v1181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:52.893 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:09:52.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:52 smithi084 bash[27323]: cluster 1689214190.8429217 mgr.a (mgr.14152) 1307 : cluster 0 pgmap v1181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:52.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:52 smithi022 bash[26979]: cluster 1689214190.8429217 mgr.a (mgr.14152) 1307 : cluster 0 pgmap v1181: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:54.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:54 smithi154 bash[27744]: cluster 1689214192.843441 mgr.a (mgr.14152) 1308 : cluster 0 pgmap v1182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:54.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:54 smithi137 bash[27262]: cluster 1689214192.843441 mgr.a (mgr.14152) 1308 : cluster 0 pgmap v1182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:54.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:54 smithi103 bash[27315]: cluster 1689214192.843441 mgr.a (mgr.14152) 1308 : cluster 0 pgmap v1182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:54.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:54 smithi084 bash[27323]: cluster 1689214192.843441 mgr.a (mgr.14152) 1308 : cluster 0 pgmap v1182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:54.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:54 smithi022 bash[26979]: cluster 1689214192.843441 mgr.a (mgr.14152) 1308 : cluster 0 pgmap v1182: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:56.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:56 smithi154 bash[27744]: cluster 1689214194.8440557 mgr.a (mgr.14152) 1309 : cluster 0 pgmap v1183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:56.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:56 smithi137 bash[27262]: cluster 1689214194.8440557 mgr.a (mgr.14152) 1309 : cluster 0 pgmap v1183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:56.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:56 smithi103 bash[27315]: cluster 1689214194.8440557 mgr.a (mgr.14152) 1309 : cluster 0 pgmap v1183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:56.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:56 smithi084 bash[27323]: cluster 1689214194.8440557 mgr.a (mgr.14152) 1309 : cluster 0 pgmap v1183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:56.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:56 smithi022 bash[26979]: cluster 1689214194.8440557 mgr.a (mgr.14152) 1309 : cluster 0 pgmap v1183: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:57.587 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:09:58.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:09:58 smithi022 bash[26979]: cluster 1689214196.8446426 mgr.a (mgr.14152) 1310 : cluster 0 pgmap v1184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:58.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:09:58 smithi154 bash[27744]: cluster 1689214196.8446426 mgr.a (mgr.14152) 1310 : cluster 0 pgmap v1184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:58.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:09:58 smithi137 bash[27262]: cluster 1689214196.8446426 mgr.a (mgr.14152) 1310 : cluster 0 pgmap v1184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:58.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:09:58 smithi103 bash[27315]: cluster 1689214196.8446426 mgr.a (mgr.14152) 1310 : cluster 0 pgmap v1184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:09:58.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:09:58 smithi084 bash[27323]: cluster 1689214196.8446426 mgr.a (mgr.14152) 1310 : cluster 0 pgmap v1184: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:00.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214198.8452208 mgr.a (mgr.14152) 1311 : cluster 0 pgmap v1185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:00.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0001912 mon.a (mon.0) 1268 : cluster 3 Health detail: HEALTH_WARN 15 failed cephadm daemon(s) 2023-07-13T02:10:00.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0002384 mon.a (mon.0) 1269 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 15 failed cephadm daemon(s) 2023-07-13T02:10:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.000288 mon.a (mon.0) 1270 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:10:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0003433 mon.a (mon.0) 1271 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:10:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.000387 mon.a (mon.0) 1272 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:10:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.000425 mon.a (mon.0) 1273 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:10:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0004652 mon.a (mon.0) 1274 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:10:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0004973 mon.a (mon.0) 1275 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0005305 mon.a (mon.0) 1276 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0005672 mon.a (mon.0) 1277 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.000602 mon.a (mon.0) 1278 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0006347 mon.a (mon.0) 1279 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0006704 mon.a (mon.0) 1280 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.000707 mon.a (mon.0) 1281 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:10:00.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0007434 mon.a (mon.0) 1282 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:10:00.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.000781 mon.a (mon.0) 1283 : cluster 3 daemon osd.13 on smithi154 is in error state 2023-07-13T02:10:00.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:00 smithi022 bash[26979]: cluster 1689214200.0008223 mon.a (mon.0) 1284 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:10:00.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214198.8452208 mgr.a (mgr.14152) 1311 : cluster 0 pgmap v1185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0001912 mon.a (mon.0) 1268 : cluster 3 Health detail: HEALTH_WARN 15 failed cephadm daemon(s) 2023-07-13T02:10:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0002384 mon.a (mon.0) 1269 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 15 failed cephadm daemon(s) 2023-07-13T02:10:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.000288 mon.a (mon.0) 1270 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:10:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0003433 mon.a (mon.0) 1271 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:10:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.000387 mon.a (mon.0) 1272 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.000425 mon.a (mon.0) 1273 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0004652 mon.a (mon.0) 1274 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0004973 mon.a (mon.0) 1275 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0005305 mon.a (mon.0) 1276 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0005672 mon.a (mon.0) 1277 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.000602 mon.a (mon.0) 1278 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0006347 mon.a (mon.0) 1279 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:10:00.772 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0006704 mon.a (mon.0) 1280 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:10:00.773 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.000707 mon.a (mon.0) 1281 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:10:00.773 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0007434 mon.a (mon.0) 1282 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:10:00.773 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.000781 mon.a (mon.0) 1283 : cluster 3 daemon osd.13 on smithi154 is in error state 2023-07-13T02:10:00.773 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:00 smithi154 bash[27744]: cluster 1689214200.0008223 mon.a (mon.0) 1284 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:10:00.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214198.8452208 mgr.a (mgr.14152) 1311 : cluster 0 pgmap v1185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:00.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0001912 mon.a (mon.0) 1268 : cluster 3 Health detail: HEALTH_WARN 15 failed cephadm daemon(s) 2023-07-13T02:10:00.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0002384 mon.a (mon.0) 1269 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 15 failed cephadm daemon(s) 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.000288 mon.a (mon.0) 1270 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0003433 mon.a (mon.0) 1271 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.000387 mon.a (mon.0) 1272 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.000425 mon.a (mon.0) 1273 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0004652 mon.a (mon.0) 1274 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0004973 mon.a (mon.0) 1275 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:10:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0005305 mon.a (mon.0) 1276 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0005672 mon.a (mon.0) 1277 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.000602 mon.a (mon.0) 1278 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0006347 mon.a (mon.0) 1279 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0006704 mon.a (mon.0) 1280 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.000707 mon.a (mon.0) 1281 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0007434 mon.a (mon.0) 1282 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:10:00.819 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.000781 mon.a (mon.0) 1283 : cluster 3 daemon osd.13 on smithi154 is in error state 2023-07-13T02:10:00.820 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:00 smithi137 bash[27262]: cluster 1689214200.0008223 mon.a (mon.0) 1284 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:10:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:10:00.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214198.8452208 mgr.a (mgr.14152) 1311 : cluster 0 pgmap v1185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:00.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0001912 mon.a (mon.0) 1268 : cluster 3 Health detail: HEALTH_WARN 15 failed cephadm daemon(s) 2023-07-13T02:10:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0002384 mon.a (mon.0) 1269 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 15 failed cephadm daemon(s) 2023-07-13T02:10:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.000288 mon.a (mon.0) 1270 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:10:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0003433 mon.a (mon.0) 1271 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:10:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.000387 mon.a (mon.0) 1272 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:10:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.000425 mon.a (mon.0) 1273 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0004652 mon.a (mon.0) 1274 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0004973 mon.a (mon.0) 1275 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0005305 mon.a (mon.0) 1276 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0005672 mon.a (mon.0) 1277 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.000602 mon.a (mon.0) 1278 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0006347 mon.a (mon.0) 1279 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0006704 mon.a (mon.0) 1280 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:10:00.869 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.000707 mon.a (mon.0) 1281 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:10:00.870 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0007434 mon.a (mon.0) 1282 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:10:00.870 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.000781 mon.a (mon.0) 1283 : cluster 3 daemon osd.13 on smithi154 is in error state 2023-07-13T02:10:00.870 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:00 smithi103 bash[27315]: cluster 1689214200.0008223 mon.a (mon.0) 1284 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:10:00.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214198.8452208 mgr.a (mgr.14152) 1311 : cluster 0 pgmap v1185: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:00.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0001912 mon.a (mon.0) 1268 : cluster 3 Health detail: HEALTH_WARN 15 failed cephadm daemon(s) 2023-07-13T02:10:00.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0002384 mon.a (mon.0) 1269 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 15 failed cephadm daemon(s) 2023-07-13T02:10:00.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.000288 mon.a (mon.0) 1270 : cluster 3 daemon osd.0 on smithi022 is in error state 2023-07-13T02:10:00.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0003433 mon.a (mon.0) 1271 : cluster 3 daemon osd.1 on smithi022 is in error state 2023-07-13T02:10:00.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.000387 mon.a (mon.0) 1272 : cluster 3 daemon osd.2 on smithi022 is in error state 2023-07-13T02:10:00.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.000425 mon.a (mon.0) 1273 : cluster 3 daemon osd.3 on smithi084 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0004652 mon.a (mon.0) 1274 : cluster 3 daemon osd.4 on smithi084 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0004973 mon.a (mon.0) 1275 : cluster 3 daemon osd.5 on smithi084 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0005305 mon.a (mon.0) 1276 : cluster 3 daemon osd.6 on smithi103 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0005672 mon.a (mon.0) 1277 : cluster 3 daemon osd.7 on smithi103 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.000602 mon.a (mon.0) 1278 : cluster 3 daemon osd.8 on smithi103 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0006347 mon.a (mon.0) 1279 : cluster 3 daemon osd.9 on smithi137 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0006704 mon.a (mon.0) 1280 : cluster 3 daemon osd.10 on smithi137 is in error state 2023-07-13T02:10:00.907 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.000707 mon.a (mon.0) 1281 : cluster 3 daemon osd.11 on smithi137 is in error state 2023-07-13T02:10:00.908 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0007434 mon.a (mon.0) 1282 : cluster 3 daemon osd.12 on smithi154 is in error state 2023-07-13T02:10:00.908 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.000781 mon.a (mon.0) 1283 : cluster 3 daemon osd.13 on smithi154 is in error state 2023-07-13T02:10:00.908 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:00 smithi084 bash[27323]: cluster 1689214200.0008223 mon.a (mon.0) 1284 : cluster 3 daemon osd.14 on smithi154 is in error state 2023-07-13T02:10:01.622 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:10:01.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:01 smithi154 bash[27744]: audit 1689214200.8415444 mon.a (mon.0) 1285 : audit 0 from='client.? 172.21.15.22:0/1522261559' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:01.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:01 smithi137 bash[27262]: audit 1689214200.8415444 mon.a (mon.0) 1285 : audit 0 from='client.? 172.21.15.22:0/1522261559' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:01.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:01 smithi103 bash[27315]: audit 1689214200.8415444 mon.a (mon.0) 1285 : audit 0 from='client.? 172.21.15.22:0/1522261559' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:01.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:01 smithi084 bash[27323]: audit 1689214200.8415444 mon.a (mon.0) 1285 : audit 0 from='client.? 172.21.15.22:0/1522261559' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:01.919 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:01 smithi022 bash[26979]: audit 1689214200.8415444 mon.a (mon.0) 1285 : audit 0 from='client.? 172.21.15.22:0/1522261559' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:02.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:10:02.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:02 smithi154 bash[27744]: cluster 1689214200.8457825 mgr.a (mgr.14152) 1312 : cluster 0 pgmap v1186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:02.816 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:02 smithi137 bash[27262]: cluster 1689214200.8457825 mgr.a (mgr.14152) 1312 : cluster 0 pgmap v1186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:02.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:02 smithi103 bash[27315]: cluster 1689214200.8457825 mgr.a (mgr.14152) 1312 : cluster 0 pgmap v1186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:02.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:02 smithi084 bash[27323]: cluster 1689214200.8457825 mgr.a (mgr.14152) 1312 : cluster 0 pgmap v1186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:02.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:02 smithi022 bash[26979]: cluster 1689214200.8457825 mgr.a (mgr.14152) 1312 : cluster 0 pgmap v1186: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:04.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:04 smithi154 bash[27744]: cluster 1689214202.8463502 mgr.a (mgr.14152) 1313 : cluster 0 pgmap v1187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:04.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:04 smithi137 bash[27262]: cluster 1689214202.8463502 mgr.a (mgr.14152) 1313 : cluster 0 pgmap v1187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:04.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:04 smithi103 bash[27315]: cluster 1689214202.8463502 mgr.a (mgr.14152) 1313 : cluster 0 pgmap v1187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:04.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:04 smithi084 bash[27323]: cluster 1689214202.8463502 mgr.a (mgr.14152) 1313 : cluster 0 pgmap v1187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:04.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:04 smithi022 bash[26979]: cluster 1689214202.8463502 mgr.a (mgr.14152) 1313 : cluster 0 pgmap v1187: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:06.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:06 smithi154 bash[27744]: cluster 1689214204.8469145 mgr.a (mgr.14152) 1314 : cluster 0 pgmap v1188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:06.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:06 smithi137 bash[27262]: cluster 1689214204.8469145 mgr.a (mgr.14152) 1314 : cluster 0 pgmap v1188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:06.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:06 smithi103 bash[27315]: cluster 1689214204.8469145 mgr.a (mgr.14152) 1314 : cluster 0 pgmap v1188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:06.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:06 smithi084 bash[27323]: cluster 1689214204.8469145 mgr.a (mgr.14152) 1314 : cluster 0 pgmap v1188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:06.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:06 smithi022 bash[26979]: cluster 1689214204.8469145 mgr.a (mgr.14152) 1314 : cluster 0 pgmap v1188: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:07.316 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:10:08.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:08 smithi022 bash[26979]: cluster 1689214206.8473792 mgr.a (mgr.14152) 1315 : cluster 0 pgmap v1189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:08.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:08 smithi154 bash[27744]: cluster 1689214206.8473792 mgr.a (mgr.14152) 1315 : cluster 0 pgmap v1189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:08.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:08 smithi137 bash[27262]: cluster 1689214206.8473792 mgr.a (mgr.14152) 1315 : cluster 0 pgmap v1189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:08.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:08 smithi103 bash[27315]: cluster 1689214206.8473792 mgr.a (mgr.14152) 1315 : cluster 0 pgmap v1189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:08.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:08 smithi084 bash[27323]: cluster 1689214206.8473792 mgr.a (mgr.14152) 1315 : cluster 0 pgmap v1189: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:10.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:10 smithi022 bash[26979]: cluster 1689214208.8479881 mgr.a (mgr.14152) 1316 : cluster 0 pgmap v1190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:10.729 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:10:10.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:10 smithi154 bash[27744]: cluster 1689214208.8479881 mgr.a (mgr.14152) 1316 : cluster 0 pgmap v1190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:10.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:10 smithi137 bash[27262]: cluster 1689214208.8479881 mgr.a (mgr.14152) 1316 : cluster 0 pgmap v1190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:10.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:10 smithi103 bash[27315]: cluster 1689214208.8479881 mgr.a (mgr.14152) 1316 : cluster 0 pgmap v1190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:10.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:10 smithi084 bash[27323]: cluster 1689214208.8479881 mgr.a (mgr.14152) 1316 : cluster 0 pgmap v1190: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:11.468 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:10:11.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:11 smithi154 bash[27744]: audit 1689214210.7239926 mon.a (mon.0) 1286 : audit 0 from='client.? 172.21.15.22:0/1051663443' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:11.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:11 smithi137 bash[27262]: audit 1689214210.7239926 mon.a (mon.0) 1286 : audit 0 from='client.? 172.21.15.22:0/1051663443' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:11.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:11 smithi103 bash[27315]: audit 1689214210.7239926 mon.a (mon.0) 1286 : audit 0 from='client.? 172.21.15.22:0/1051663443' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:11.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:11 smithi084 bash[27323]: audit 1689214210.7239926 mon.a (mon.0) 1286 : audit 0 from='client.? 172.21.15.22:0/1051663443' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:11.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:11 smithi022 bash[26979]: audit 1689214210.7239926 mon.a (mon.0) 1286 : audit 0 from='client.? 172.21.15.22:0/1051663443' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:12.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:10:12.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:12 smithi154 bash[27744]: cluster 1689214210.8485377 mgr.a (mgr.14152) 1317 : cluster 0 pgmap v1191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:12.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:12 smithi137 bash[27262]: cluster 1689214210.8485377 mgr.a (mgr.14152) 1317 : cluster 0 pgmap v1191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:12.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:12 smithi103 bash[27315]: cluster 1689214210.8485377 mgr.a (mgr.14152) 1317 : cluster 0 pgmap v1191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:12.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:12 smithi084 bash[27323]: cluster 1689214210.8485377 mgr.a (mgr.14152) 1317 : cluster 0 pgmap v1191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:12.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:12 smithi022 bash[26979]: cluster 1689214210.8485377 mgr.a (mgr.14152) 1317 : cluster 0 pgmap v1191: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:14.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:14 smithi154 bash[27744]: cluster 1689214212.849156 mgr.a (mgr.14152) 1318 : cluster 0 pgmap v1192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:14.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:14 smithi137 bash[27262]: cluster 1689214212.849156 mgr.a (mgr.14152) 1318 : cluster 0 pgmap v1192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:14.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:14 smithi103 bash[27315]: cluster 1689214212.849156 mgr.a (mgr.14152) 1318 : cluster 0 pgmap v1192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:14.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:14 smithi084 bash[27323]: cluster 1689214212.849156 mgr.a (mgr.14152) 1318 : cluster 0 pgmap v1192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:14.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:14 smithi022 bash[26979]: cluster 1689214212.849156 mgr.a (mgr.14152) 1318 : cluster 0 pgmap v1192: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:16.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:16 smithi154 bash[27744]: cluster 1689214214.8498056 mgr.a (mgr.14152) 1319 : cluster 0 pgmap v1193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:16.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:16 smithi137 bash[27262]: cluster 1689214214.8498056 mgr.a (mgr.14152) 1319 : cluster 0 pgmap v1193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:16.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:16 smithi103 bash[27315]: cluster 1689214214.8498056 mgr.a (mgr.14152) 1319 : cluster 0 pgmap v1193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:16.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:16 smithi084 bash[27323]: cluster 1689214214.8498056 mgr.a (mgr.14152) 1319 : cluster 0 pgmap v1193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:16.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:16 smithi022 bash[26979]: cluster 1689214214.8498056 mgr.a (mgr.14152) 1319 : cluster 0 pgmap v1193: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:17.169 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:10:18.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:18 smithi154 bash[27744]: cluster 1689214216.8503919 mgr.a (mgr.14152) 1320 : cluster 0 pgmap v1194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:18.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:18 smithi137 bash[27262]: cluster 1689214216.8503919 mgr.a (mgr.14152) 1320 : cluster 0 pgmap v1194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:18.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:18 smithi103 bash[27315]: cluster 1689214216.8503919 mgr.a (mgr.14152) 1320 : cluster 0 pgmap v1194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:18.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:18 smithi084 bash[27323]: cluster 1689214216.8503919 mgr.a (mgr.14152) 1320 : cluster 0 pgmap v1194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:18.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:18 smithi022 bash[26979]: cluster 1689214216.8503919 mgr.a (mgr.14152) 1320 : cluster 0 pgmap v1194: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:20.505 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:10:20.770 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:20 smithi154 bash[27744]: cluster 1689214218.850956 mgr.a (mgr.14152) 1321 : cluster 0 pgmap v1195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:20.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:20 smithi154 bash[27744]: audit 1689214220.500381 mon.d (mon.3) 24 : audit 0 from='client.? 172.21.15.22:0/3780484733' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:20.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:20 smithi137 bash[27262]: cluster 1689214218.850956 mgr.a (mgr.14152) 1321 : cluster 0 pgmap v1195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:20.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:20 smithi137 bash[27262]: audit 1689214220.500381 mon.d (mon.3) 24 : audit 0 from='client.? 172.21.15.22:0/3780484733' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:20.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:20 smithi103 bash[27315]: cluster 1689214218.850956 mgr.a (mgr.14152) 1321 : cluster 0 pgmap v1195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:20.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:20 smithi103 bash[27315]: audit 1689214220.500381 mon.d (mon.3) 24 : audit 0 from='client.? 172.21.15.22:0/3780484733' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:20.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:20 smithi084 bash[27323]: cluster 1689214218.850956 mgr.a (mgr.14152) 1321 : cluster 0 pgmap v1195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:20.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:20 smithi084 bash[27323]: audit 1689214220.500381 mon.d (mon.3) 24 : audit 0 from='client.? 172.21.15.22:0/3780484733' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:20.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:20 smithi022 bash[26979]: cluster 1689214218.850956 mgr.a (mgr.14152) 1321 : cluster 0 pgmap v1195: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:20.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:20 smithi022 bash[26979]: audit 1689214220.500381 mon.d (mon.3) 24 : audit 0 from='client.? 172.21.15.22:0/3780484733' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:21.264 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:10:22.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:10:22.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:22 smithi022 bash[26979]: cluster 1689214220.8513978 mgr.a (mgr.14152) 1322 : cluster 0 pgmap v1196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:22.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:22 smithi154 bash[27744]: cluster 1689214220.8513978 mgr.a (mgr.14152) 1322 : cluster 0 pgmap v1196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:22.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:22 smithi137 bash[27262]: cluster 1689214220.8513978 mgr.a (mgr.14152) 1322 : cluster 0 pgmap v1196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:22.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:22 smithi103 bash[27315]: cluster 1689214220.8513978 mgr.a (mgr.14152) 1322 : cluster 0 pgmap v1196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:22.905 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:22 smithi084 bash[27323]: cluster 1689214220.8513978 mgr.a (mgr.14152) 1322 : cluster 0 pgmap v1196: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:24.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:24 smithi137 bash[27262]: cluster 1689214222.8519328 mgr.a (mgr.14152) 1323 : cluster 0 pgmap v1197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:24.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:24 smithi103 bash[27315]: cluster 1689214222.8519328 mgr.a (mgr.14152) 1323 : cluster 0 pgmap v1197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:24.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:24 smithi084 bash[27323]: cluster 1689214222.8519328 mgr.a (mgr.14152) 1323 : cluster 0 pgmap v1197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:24.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:24 smithi022 bash[26979]: cluster 1689214222.8519328 mgr.a (mgr.14152) 1323 : cluster 0 pgmap v1197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:25.021 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:24 smithi154 bash[27744]: cluster 1689214222.8519328 mgr.a (mgr.14152) 1323 : cluster 0 pgmap v1197: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:26.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:26 smithi137 bash[27262]: cluster 1689214224.852432 mgr.a (mgr.14152) 1324 : cluster 0 pgmap v1198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:26.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:26 smithi103 bash[27315]: cluster 1689214224.852432 mgr.a (mgr.14152) 1324 : cluster 0 pgmap v1198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:26.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:26 smithi084 bash[27323]: cluster 1689214224.852432 mgr.a (mgr.14152) 1324 : cluster 0 pgmap v1198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:26.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:26 smithi022 bash[26979]: cluster 1689214224.852432 mgr.a (mgr.14152) 1324 : cluster 0 pgmap v1198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:26.961 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:10:27.021 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:26 smithi154 bash[27744]: cluster 1689214224.852432 mgr.a (mgr.14152) 1324 : cluster 0 pgmap v1198: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:28.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:28 smithi022 bash[26979]: cluster 1689214226.8529253 mgr.a (mgr.14152) 1325 : cluster 0 pgmap v1199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:28.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:28 smithi137 bash[27262]: cluster 1689214226.8529253 mgr.a (mgr.14152) 1325 : cluster 0 pgmap v1199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:28.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:28 smithi103 bash[27315]: cluster 1689214226.8529253 mgr.a (mgr.14152) 1325 : cluster 0 pgmap v1199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:28.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:28 smithi084 bash[27323]: cluster 1689214226.8529253 mgr.a (mgr.14152) 1325 : cluster 0 pgmap v1199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:29.021 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:28 smithi154 bash[27744]: cluster 1689214226.8529253 mgr.a (mgr.14152) 1325 : cluster 0 pgmap v1199: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:29.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:29 smithi137 bash[27262]: cluster 1689214228.853441 mgr.a (mgr.14152) 1326 : cluster 0 pgmap v1200: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:29.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:29 smithi022 bash[26979]: cluster 1689214228.853441 mgr.a (mgr.14152) 1326 : cluster 0 pgmap v1200: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:29.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:29 smithi103 bash[27315]: cluster 1689214228.853441 mgr.a (mgr.14152) 1326 : cluster 0 pgmap v1200: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:29.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:29 smithi084 bash[27323]: cluster 1689214228.853441 mgr.a (mgr.14152) 1326 : cluster 0 pgmap v1200: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:30.020 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:29 smithi154 bash[27744]: cluster 1689214228.853441 mgr.a (mgr.14152) 1326 : cluster 0 pgmap v1200: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:30.279 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:10:30.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:30 smithi022 bash[26979]: audit 1689214230.274029 mon.a (mon.0) 1287 : audit 0 from='client.? 172.21.15.22:0/115818487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:30.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:30 smithi137 bash[27262]: audit 1689214230.274029 mon.a (mon.0) 1287 : audit 0 from='client.? 172.21.15.22:0/115818487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:30.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:30 smithi103 bash[27315]: audit 1689214230.274029 mon.a (mon.0) 1287 : audit 0 from='client.? 172.21.15.22:0/115818487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:30.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:30 smithi084 bash[27323]: audit 1689214230.274029 mon.a (mon.0) 1287 : audit 0 from='client.? 172.21.15.22:0/115818487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:31.021 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:30 smithi154 bash[27744]: audit 1689214230.274029 mon.a (mon.0) 1287 : audit 0 from='client.? 172.21.15.22:0/115818487' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:31.118 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:10:31.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:31 smithi137 bash[27262]: cluster 1689214230.853952 mgr.a (mgr.14152) 1327 : cluster 0 pgmap v1201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:31.867 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:31 smithi103 bash[27315]: cluster 1689214230.853952 mgr.a (mgr.14152) 1327 : cluster 0 pgmap v1201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:31.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:31 smithi084 bash[27323]: cluster 1689214230.853952 mgr.a (mgr.14152) 1327 : cluster 0 pgmap v1201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:31.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:31 smithi022 bash[26979]: cluster 1689214230.853952 mgr.a (mgr.14152) 1327 : cluster 0 pgmap v1201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:32.021 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:31 smithi154 bash[27744]: cluster 1689214230.853952 mgr.a (mgr.14152) 1327 : cluster 0 pgmap v1201: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:32.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:10:34.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:33 smithi022 bash[26979]: cluster 1689214232.8544624 mgr.a (mgr.14152) 1328 : cluster 0 pgmap v1202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:34.271 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:33 smithi154 bash[27744]: cluster 1689214232.8544624 mgr.a (mgr.14152) 1328 : cluster 0 pgmap v1202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:34.317 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:33 smithi137 bash[27262]: cluster 1689214232.8544624 mgr.a (mgr.14152) 1328 : cluster 0 pgmap v1202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:34.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:33 smithi103 bash[27315]: cluster 1689214232.8544624 mgr.a (mgr.14152) 1328 : cluster 0 pgmap v1202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:34.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:33 smithi084 bash[27323]: cluster 1689214232.8544624 mgr.a (mgr.14152) 1328 : cluster 0 pgmap v1202: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:36.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:36 smithi154 bash[27744]: cluster 1689214234.8550718 mgr.a (mgr.14152) 1329 : cluster 0 pgmap v1203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:36.817 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:10:36.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:36 smithi137 bash[27262]: cluster 1689214234.8550718 mgr.a (mgr.14152) 1329 : cluster 0 pgmap v1203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:36 smithi022 bash[26979]: cluster 1689214234.8550718 mgr.a (mgr.14152) 1329 : cluster 0 pgmap v1203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:36.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:36 smithi103 bash[27315]: cluster 1689214234.8550718 mgr.a (mgr.14152) 1329 : cluster 0 pgmap v1203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:36.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:36 smithi084 bash[27323]: cluster 1689214234.8550718 mgr.a (mgr.14152) 1329 : cluster 0 pgmap v1203: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:38.747 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:38 smithi022 bash[26979]: cluster 1689214236.8554752 mgr.a (mgr.14152) 1330 : cluster 0 pgmap v1204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:38.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:38 smithi154 bash[27744]: cluster 1689214236.8554752 mgr.a (mgr.14152) 1330 : cluster 0 pgmap v1204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:38.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:38 smithi137 bash[27262]: cluster 1689214236.8554752 mgr.a (mgr.14152) 1330 : cluster 0 pgmap v1204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:38.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:38 smithi103 bash[27315]: cluster 1689214236.8554752 mgr.a (mgr.14152) 1330 : cluster 0 pgmap v1204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:38.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:38 smithi084 bash[27323]: cluster 1689214236.8554752 mgr.a (mgr.14152) 1330 : cluster 0 pgmap v1204: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:40.198 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:10:40.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:40 smithi022 bash[26979]: cluster 1689214238.8559904 mgr.a (mgr.14152) 1331 : cluster 0 pgmap v1205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:40.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:40 smithi022 bash[26979]: audit 1689214240.1932788 mon.d (mon.3) 25 : audit 0 from='client.? 172.21.15.22:0/1000967227' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:40.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:40 smithi154 bash[27744]: cluster 1689214238.8559904 mgr.a (mgr.14152) 1331 : cluster 0 pgmap v1205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:40.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:40 smithi154 bash[27744]: audit 1689214240.1932788 mon.d (mon.3) 25 : audit 0 from='client.? 172.21.15.22:0/1000967227' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:40.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:40 smithi137 bash[27262]: cluster 1689214238.8559904 mgr.a (mgr.14152) 1331 : cluster 0 pgmap v1205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:40.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:40 smithi137 bash[27262]: audit 1689214240.1932788 mon.d (mon.3) 25 : audit 0 from='client.? 172.21.15.22:0/1000967227' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:40.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:40 smithi103 bash[27315]: cluster 1689214238.8559904 mgr.a (mgr.14152) 1331 : cluster 0 pgmap v1205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:40.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:40 smithi103 bash[27315]: audit 1689214240.1932788 mon.d (mon.3) 25 : audit 0 from='client.? 172.21.15.22:0/1000967227' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:40.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:40 smithi084 bash[27323]: cluster 1689214238.8559904 mgr.a (mgr.14152) 1331 : cluster 0 pgmap v1205: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:40.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:40 smithi084 bash[27323]: audit 1689214240.1932788 mon.d (mon.3) 25 : audit 0 from='client.? 172.21.15.22:0/1000967227' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:40.917 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:10:41.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:10:42.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:42 smithi154 bash[27744]: cluster 1689214240.8565319 mgr.a (mgr.14152) 1332 : cluster 0 pgmap v1206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:42.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:42 smithi137 bash[27262]: cluster 1689214240.8565319 mgr.a (mgr.14152) 1332 : cluster 0 pgmap v1206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:42.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:42 smithi103 bash[27315]: cluster 1689214240.8565319 mgr.a (mgr.14152) 1332 : cluster 0 pgmap v1206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:42.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:42 smithi084 bash[27323]: cluster 1689214240.8565319 mgr.a (mgr.14152) 1332 : cluster 0 pgmap v1206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:42.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:42 smithi022 bash[26979]: cluster 1689214240.8565319 mgr.a (mgr.14152) 1332 : cluster 0 pgmap v1206: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:44.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:44 smithi154 bash[27744]: cluster 1689214242.857055 mgr.a (mgr.14152) 1333 : cluster 0 pgmap v1207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:44.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:44 smithi137 bash[27262]: cluster 1689214242.857055 mgr.a (mgr.14152) 1333 : cluster 0 pgmap v1207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:44.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:44 smithi103 bash[27315]: cluster 1689214242.857055 mgr.a (mgr.14152) 1333 : cluster 0 pgmap v1207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:44.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:44 smithi084 bash[27323]: cluster 1689214242.857055 mgr.a (mgr.14152) 1333 : cluster 0 pgmap v1207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:44.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:44 smithi022 bash[26979]: cluster 1689214242.857055 mgr.a (mgr.14152) 1333 : cluster 0 pgmap v1207: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:46.613 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:10:46.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:46 smithi154 bash[27744]: cluster 1689214244.8576107 mgr.a (mgr.14152) 1334 : cluster 0 pgmap v1208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:46.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:46 smithi137 bash[27262]: cluster 1689214244.8576107 mgr.a (mgr.14152) 1334 : cluster 0 pgmap v1208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:46.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:46 smithi103 bash[27315]: cluster 1689214244.8576107 mgr.a (mgr.14152) 1334 : cluster 0 pgmap v1208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:46.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:46 smithi084 bash[27323]: cluster 1689214244.8576107 mgr.a (mgr.14152) 1334 : cluster 0 pgmap v1208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:46.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:46 smithi022 bash[26979]: cluster 1689214244.8576107 mgr.a (mgr.14152) 1334 : cluster 0 pgmap v1208: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:48.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:48 smithi154 bash[27744]: cluster 1689214246.8580892 mgr.a (mgr.14152) 1335 : cluster 0 pgmap v1209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:48.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:48 smithi137 bash[27262]: cluster 1689214246.8580892 mgr.a (mgr.14152) 1335 : cluster 0 pgmap v1209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:48.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:48 smithi103 bash[27315]: cluster 1689214246.8580892 mgr.a (mgr.14152) 1335 : cluster 0 pgmap v1209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:48.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:48 smithi084 bash[27323]: cluster 1689214246.8580892 mgr.a (mgr.14152) 1335 : cluster 0 pgmap v1209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:48.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:48 smithi022 bash[26979]: cluster 1689214246.8580892 mgr.a (mgr.14152) 1335 : cluster 0 pgmap v1209: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:49.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:49 smithi154 bash[27744]: audit 1689214249.0148058 mon.a (mon.0) 1288 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:10:49.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:49 smithi137 bash[27262]: audit 1689214249.0148058 mon.a (mon.0) 1288 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:10:49.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:49 smithi103 bash[27315]: audit 1689214249.0148058 mon.a (mon.0) 1288 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:10:49.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:49 smithi084 bash[27323]: audit 1689214249.0148058 mon.a (mon.0) 1288 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:10:49.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:49 smithi022 bash[26979]: audit 1689214249.0148058 mon.a (mon.0) 1288 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-13T02:10:50.025 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:10:50.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:50 smithi022 bash[26979]: cluster 1689214248.858607 mgr.a (mgr.14152) 1336 : cluster 0 pgmap v1210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:50.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:50 smithi022 bash[26979]: audit 1689214250.0199587 mon.c (mon.2) 25 : audit 0 from='client.? 172.21.15.22:0/1339951590' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:50.763 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:10:50.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:50 smithi154 bash[27744]: cluster 1689214248.858607 mgr.a (mgr.14152) 1336 : cluster 0 pgmap v1210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:50.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:50 smithi154 bash[27744]: audit 1689214250.0199587 mon.c (mon.2) 25 : audit 0 from='client.? 172.21.15.22:0/1339951590' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:50.817 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:50 smithi137 bash[27262]: cluster 1689214248.858607 mgr.a (mgr.14152) 1336 : cluster 0 pgmap v1210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:50.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:50 smithi137 bash[27262]: audit 1689214250.0199587 mon.c (mon.2) 25 : audit 0 from='client.? 172.21.15.22:0/1339951590' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:50.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:50 smithi103 bash[27315]: cluster 1689214248.858607 mgr.a (mgr.14152) 1336 : cluster 0 pgmap v1210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:50.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:50 smithi103 bash[27315]: audit 1689214250.0199587 mon.c (mon.2) 25 : audit 0 from='client.? 172.21.15.22:0/1339951590' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:50.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:50 smithi084 bash[27323]: cluster 1689214248.858607 mgr.a (mgr.14152) 1336 : cluster 0 pgmap v1210: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:50.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:50 smithi084 bash[27323]: audit 1689214250.0199587 mon.c (mon.2) 25 : audit 0 from='client.? 172.21.15.22:0/1339951590' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:10:51.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3990f91ac125621431ef1b77c2fc96421bec9e51 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f81712b0-211c-11ee-9b31-001a4aab830c -- ceph osd stat -f json 2023-07-13T02:10:52.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:52 smithi154 bash[27744]: cluster 1689214250.8591905 mgr.a (mgr.14152) 1337 : cluster 0 pgmap v1211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:52.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:52 smithi137 bash[27262]: cluster 1689214250.8591905 mgr.a (mgr.14152) 1337 : cluster 0 pgmap v1211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:52.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:52 smithi103 bash[27315]: cluster 1689214250.8591905 mgr.a (mgr.14152) 1337 : cluster 0 pgmap v1211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:52.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:52 smithi084 bash[27323]: cluster 1689214250.8591905 mgr.a (mgr.14152) 1337 : cluster 0 pgmap v1211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:52.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:52 smithi022 bash[26979]: cluster 1689214250.8591905 mgr.a (mgr.14152) 1337 : cluster 0 pgmap v1211: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:54.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:54 smithi154 bash[27744]: cluster 1689214252.859741 mgr.a (mgr.14152) 1338 : cluster 0 pgmap v1212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:54.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:54 smithi137 bash[27262]: cluster 1689214252.859741 mgr.a (mgr.14152) 1338 : cluster 0 pgmap v1212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:54.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:54 smithi103 bash[27315]: cluster 1689214252.859741 mgr.a (mgr.14152) 1338 : cluster 0 pgmap v1212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:54.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:54 smithi084 bash[27323]: cluster 1689214252.859741 mgr.a (mgr.14152) 1338 : cluster 0 pgmap v1212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:54.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:54 smithi022 bash[26979]: cluster 1689214252.859741 mgr.a (mgr.14152) 1338 : cluster 0 pgmap v1212: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: cluster 1689214254.8602254 mgr.a (mgr.14152) 1339 : cluster 0 pgmap v1213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214254.9202666 mon.a (mon.0) 1289 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.272 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214254.9275854 mon.a (mon.0) 1290 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214255.4005249 mon.a (mon.0) 1291 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214255.4023468 mon.a (mon.0) 1292 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214255.403879 mon.a (mon.0) 1293 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.273 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: cephadm 1689214255.4051867 mgr.a (mgr.14152) 1340 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:10:56.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214255.407262 mon.a (mon.0) 1294 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:10:56.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214255.4085336 mon.a (mon.0) 1295 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:10:56.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: cluster 1689214255.4110017 mgr.a (mgr.14152) 1341 : cluster 0 pgmap v1214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.274 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: cluster 1689214255.4112945 mgr.a (mgr.14152) 1342 : cluster 0 pgmap v1215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.275 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:55 smithi154 bash[27744]: audit 1689214255.4187214 mon.a (mon.0) 1296 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.275 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/mon.a/config 2023-07-13T02:10:56.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: cluster 1689214254.8602254 mgr.a (mgr.14152) 1339 : cluster 0 pgmap v1213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214254.9202666 mon.a (mon.0) 1289 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214254.9275854 mon.a (mon.0) 1290 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214255.4005249 mon.a (mon.0) 1291 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214255.4023468 mon.a (mon.0) 1292 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.307 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214255.403879 mon.a (mon.0) 1293 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: cephadm 1689214255.4051867 mgr.a (mgr.14152) 1340 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:10:56.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214255.407262 mon.a (mon.0) 1294 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:10:56.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214255.4085336 mon.a (mon.0) 1295 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:10:56.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: cluster 1689214255.4110017 mgr.a (mgr.14152) 1341 : cluster 0 pgmap v1214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.308 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: cluster 1689214255.4112945 mgr.a (mgr.14152) 1342 : cluster 0 pgmap v1215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:55 smithi022 bash[26979]: audit 1689214255.4187214 mon.a (mon.0) 1296 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: cluster 1689214254.8602254 mgr.a (mgr.14152) 1339 : cluster 0 pgmap v1213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214254.9202666 mon.a (mon.0) 1289 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214254.9275854 mon.a (mon.0) 1290 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214255.4005249 mon.a (mon.0) 1291 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214255.4023468 mon.a (mon.0) 1292 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214255.403879 mon.a (mon.0) 1293 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.319 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: cephadm 1689214255.4051867 mgr.a (mgr.14152) 1340 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:10:56.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214255.407262 mon.a (mon.0) 1294 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:10:56.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214255.4085336 mon.a (mon.0) 1295 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:10:56.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: cluster 1689214255.4110017 mgr.a (mgr.14152) 1341 : cluster 0 pgmap v1214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: cluster 1689214255.4112945 mgr.a (mgr.14152) 1342 : cluster 0 pgmap v1215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.320 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:55 smithi137 bash[27262]: audit 1689214255.4187214 mon.a (mon.0) 1296 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.368 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: cluster 1689214254.8602254 mgr.a (mgr.14152) 1339 : cluster 0 pgmap v1213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214254.9202666 mon.a (mon.0) 1289 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214254.9275854 mon.a (mon.0) 1290 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214255.4005249 mon.a (mon.0) 1291 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.369 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214255.4023468 mon.a (mon.0) 1292 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214255.403879 mon.a (mon.0) 1293 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: cephadm 1689214255.4051867 mgr.a (mgr.14152) 1340 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214255.407262 mon.a (mon.0) 1294 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214255.4085336 mon.a (mon.0) 1295 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: cluster 1689214255.4110017 mgr.a (mgr.14152) 1341 : cluster 0 pgmap v1214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: cluster 1689214255.4112945 mgr.a (mgr.14152) 1342 : cluster 0 pgmap v1215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.370 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:55 smithi103 bash[27315]: audit 1689214255.4187214 mon.a (mon.0) 1296 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.406 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: cluster 1689214254.8602254 mgr.a (mgr.14152) 1339 : cluster 0 pgmap v1213: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214254.9202666 mon.a (mon.0) 1289 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214254.9275854 mon.a (mon.0) 1290 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:56.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214255.4005249 mon.a (mon.0) 1291 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214255.4023468 mon.a (mon.0) 1292 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214255.403879 mon.a (mon.0) 1293 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-13T02:10:56.407 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: cephadm 1689214255.4051867 mgr.a (mgr.14152) 1340 : cephadm 1 Adjusting osd_memory_target on smithi022 to 5756M 2023-07-13T02:10:56.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214255.407262 mon.a (mon.0) 1294 : audit 0 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-13T02:10:56.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214255.4085336 mon.a (mon.0) 1295 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-13T02:10:56.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: cluster 1689214255.4110017 mgr.a (mgr.14152) 1341 : cluster 0 pgmap v1214: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: cluster 1689214255.4112945 mgr.a (mgr.14152) 1342 : cluster 0 pgmap v1215: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:56.408 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:55 smithi084 bash[27323]: audit 1689214255.4187214 mon.a (mon.0) 1296 : audit 1 from='mgr.14152 172.21.15.22:0/2187505890' entity='mgr.a' 2023-07-13T02:10:58.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:10:58 smithi022 bash[26979]: cluster 1689214257.411761 mgr.a (mgr.14152) 1343 : cluster 0 pgmap v1216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:58.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:10:58 smithi154 bash[27744]: cluster 1689214257.411761 mgr.a (mgr.14152) 1343 : cluster 0 pgmap v1216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:58.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:10:58 smithi137 bash[27262]: cluster 1689214257.411761 mgr.a (mgr.14152) 1343 : cluster 0 pgmap v1216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:58.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:10:58 smithi103 bash[27315]: cluster 1689214257.411761 mgr.a (mgr.14152) 1343 : cluster 0 pgmap v1216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:58.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:10:58 smithi084 bash[27323]: cluster 1689214257.411761 mgr.a (mgr.14152) 1343 : cluster 0 pgmap v1216: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:10:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-13T02:11:00.362 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"num_osds":15,"num_up_osds":0,"osd_up_since":0,"num_in_osds":11,"osd_in_since":1689213055,"num_remapped_pgs":0} 2023-07-13T02:11:00.363 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 894, in ceph_osds while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (121) after waiting for 120 seconds 2023-07-13T02:11:00.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:00.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:00.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:00.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:00.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:00.442 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-07-13T02:11:00.443 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-13T02:11:00.450 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-13T02:11:00.458 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-13T02:11:00.465 DEBUG:teuthology.orchestra.run.smithi137:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-13T02:11:00.475 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-13T02:11:00.492 INFO:tasks.cephadm:Stopping all daemons... 2023-07-13T02:11:00.493 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-07-13T02:11:00.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a 2023-07-13T02:11:00.656 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:11:00 smithi084 bash[27323]: cluster 1689214259.4123726 mgr.a (mgr.14152) 1344 : cluster 0 pgmap v1217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:11:00.657 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:11:00 smithi084 bash[27323]: audit 1689214259.6596434 mon.b (mon.4) 36 : audit 0 from='client.? 172.21.15.22:0/1367965604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:11:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:11:00 smithi022 bash[26979]: cluster 1689214259.4123726 mgr.a (mgr.14152) 1344 : cluster 0 pgmap v1217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:11:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:11:00 smithi022 bash[26979]: audit 1689214259.6596434 mon.b (mon.4) 36 : audit 0 from='client.? 172.21.15.22:0/1367965604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:11:00.671 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:11:00 smithi022 systemd[1]: Stopping Ceph mon.a for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:11:00 smithi154 bash[27744]: cluster 1689214259.4123726 mgr.a (mgr.14152) 1344 : cluster 0 pgmap v1217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:11:00.771 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:11:00 smithi154 bash[27744]: audit 1689214259.6596434 mon.b (mon.4) 36 : audit 0 from='client.? 172.21.15.22:0/1367965604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:11:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:11:00 smithi137 bash[27262]: cluster 1689214259.4123726 mgr.a (mgr.14152) 1344 : cluster 0 pgmap v1217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:11:00.818 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:11:00 smithi137 bash[27262]: audit 1689214259.6596434 mon.b (mon.4) 36 : audit 0 from='client.? 172.21.15.22:0/1367965604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:11:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:11:00 smithi103 bash[27315]: cluster 1689214259.4123726 mgr.a (mgr.14152) 1344 : cluster 0 pgmap v1217: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-13T02:11:00.868 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:11:00 smithi103 bash[27315]: audit 1689214259.6596434 mon.b (mon.4) 36 : audit 0 from='client.? 172.21.15.22:0/1367965604' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-13T02:11:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:11:00 smithi022 bash[26979]: debug 2023-07-13T02:11:00.698+0000 7f1bb5b34700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-13T02:11:01.171 INFO:journalctl@ceph.mon.a.smithi022.stdout:Jul 13 02:11:00 smithi022 bash[26979]: debug 2023-07-13T02:11:00.698+0000 7f1bb5b34700 -1 mon.a@0(leader) e5 *** Got Signal Terminated *** 2023-07-13T02:11:01.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.a.service' 2023-07-13T02:11:01.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:01.566 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-07-13T02:11:01.566 INFO:tasks.cephadm.mon.e:Stopping mon.b... 2023-07-13T02:11:01.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.b 2023-07-13T02:11:01.906 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:11:01 smithi084 systemd[1]: Stopping Ceph mon.b for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:02.272 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:11:01 smithi084 bash[27323]: debug 2023-07-13T02:11:01.982+0000 7f3fa49b9700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-13T02:11:02.273 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jul 13 02:11:01 smithi084 bash[27323]: debug 2023-07-13T02:11:01.982+0000 7f3fa49b9700 -1 mon.b@4(peon) e5 *** Got Signal Terminated *** 2023-07-13T02:11:02.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.b.service' 2023-07-13T02:11:02.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:02.913 INFO:tasks.cephadm.mon.e:Stopped mon.b 2023-07-13T02:11:02.913 INFO:tasks.cephadm.mon.e:Stopping mon.c... 2023-07-13T02:11:02.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.c 2023-07-13T02:11:03.219 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:11:02 smithi103 systemd[1]: Stopping Ceph mon.c for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:03.220 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:11:03 smithi103 bash[27315]: debug 2023-07-13T02:11:03.105+0000 7f9bf804a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-13T02:11:03.220 INFO:journalctl@ceph.mon.c.smithi103.stdout:Jul 13 02:11:03 smithi103 bash[27315]: debug 2023-07-13T02:11:03.105+0000 7f9bf804a700 -1 mon.c@2(peon) e5 *** Got Signal Terminated *** 2023-07-13T02:11:03.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.c.service' 2023-07-13T02:11:04.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:04.013 INFO:tasks.cephadm.mon.e:Stopped mon.c 2023-07-13T02:11:04.013 INFO:tasks.cephadm.mon.e:Stopping mon.d... 2023-07-13T02:11:04.014 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.d 2023-07-13T02:11:04.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:11:04 smithi137 systemd[1]: Stopping Ceph mon.d for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:04.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:11:04 smithi137 bash[27262]: debug 2023-07-13T02:11:04.267+0000 7f048fcc2700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-13T02:11:04.318 INFO:journalctl@ceph.mon.d.smithi137.stdout:Jul 13 02:11:04 smithi137 bash[27262]: debug 2023-07-13T02:11:04.267+0000 7f048fcc2700 -1 mon.d@3(peon) e5 *** Got Signal Terminated *** 2023-07-13T02:11:05.173 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.d.service' 2023-07-13T02:11:05.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:05.206 INFO:tasks.cephadm.mon.e:Stopped mon.d 2023-07-13T02:11:05.207 INFO:tasks.cephadm.mon.e:Stopping mon.e... 2023-07-13T02:11:05.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.e 2023-07-13T02:11:05.521 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:11:05 smithi154 systemd[1]: Stopping Ceph mon.e for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:05.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:11:05 smithi154 bash[27744]: debug 2023-07-13T02:11:05.392+0000 7f8341e86700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-07-13T02:11:05.522 INFO:journalctl@ceph.mon.e.smithi154.stdout:Jul 13 02:11:05 smithi154 bash[27744]: debug 2023-07-13T02:11:05.392+0000 7f8341e86700 -1 mon.e@1(peon) e5 *** Got Signal Terminated *** 2023-07-13T02:11:06.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mon.e.service' 2023-07-13T02:11:06.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:06.459 INFO:tasks.cephadm.mon.e:Stopped mon.e 2023-07-13T02:11:06.460 INFO:tasks.cephadm.mgr.a:Stopping mgr.a... 2023-07-13T02:11:06.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a 2023-07-13T02:11:06.731 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 02:11:06 smithi022 systemd[1]: Stopping Ceph mgr.a for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:06.731 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 02:11:06 smithi022 bash[27249]: debug 2023-07-13T02:11:06.646+0000 7f0e4163b700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-07-13T02:11:06.731 INFO:journalctl@ceph.mgr.a.smithi022.stdout:Jul 13 02:11:06 smithi022 bash[27249]: debug 2023-07-13T02:11:06.646+0000 7f0e4163b700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-13T02:11:07.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.a.service' 2023-07-13T02:11:07.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:07.510 INFO:tasks.cephadm.mgr.a:Stopped mgr.a 2023-07-13T02:11:07.510 INFO:tasks.cephadm.mgr.b:Stopping mgr.b... 2023-07-13T02:11:07.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.b 2023-07-13T02:11:07.801 INFO:journalctl@ceph.mgr.b.smithi084.stdout:Jul 13 02:11:07 smithi084 systemd[1]: Stopping Ceph mgr.b for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:08.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.b.service' 2023-07-13T02:11:08.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:08.441 INFO:tasks.cephadm.mgr.b:Stopped mgr.b 2023-07-13T02:11:08.442 INFO:tasks.cephadm.mgr.c:Stopping mgr.c... 2023-07-13T02:11:08.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.c 2023-07-13T02:11:08.791 INFO:journalctl@ceph.mgr.c.smithi103.stdout:Jul 13 02:11:08 smithi103 systemd[1]: Stopping Ceph mgr.c for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:09.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.c.service' 2023-07-13T02:11:09.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:09.571 INFO:tasks.cephadm.mgr.c:Stopped mgr.c 2023-07-13T02:11:09.571 INFO:tasks.cephadm.mgr.d:Stopping mgr.d... 2023-07-13T02:11:09.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.d 2023-07-13T02:11:09.952 INFO:journalctl@ceph.mgr.d.smithi137.stdout:Jul 13 02:11:09 smithi137 systemd[1]: Stopping Ceph mgr.d for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:10.598 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.d.service' 2023-07-13T02:11:10.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:10.627 INFO:tasks.cephadm.mgr.d:Stopped mgr.d 2023-07-13T02:11:10.627 INFO:tasks.cephadm.mgr.e:Stopping mgr.e... 2023-07-13T02:11:10.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.e 2023-07-13T02:11:10.898 INFO:journalctl@ceph.mgr.e.smithi154.stdout:Jul 13 02:11:10 smithi154 systemd[1]: Stopping Ceph mgr.e for f81712b0-211c-11ee-9b31-001a4aab830c... 2023-07-13T02:11:11.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@mgr.e.service' 2023-07-13T02:11:11.690 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:11.691 INFO:tasks.cephadm.mgr.e:Stopped mgr.e 2023-07-13T02:11:11.691 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-07-13T02:11:11.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0 2023-07-13T02:11:11.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.0.service' 2023-07-13T02:11:11.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:11.791 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-07-13T02:11:11.791 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-07-13T02:11:11.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1 2023-07-13T02:11:11.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.1.service' 2023-07-13T02:11:11.932 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:11.932 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-07-13T02:11:11.932 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-07-13T02:11:11.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2 2023-07-13T02:11:11.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.2.service' 2023-07-13T02:11:12.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.082 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-07-13T02:11:12.083 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-07-13T02:11:12.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3 2023-07-13T02:11:12.103 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.3.service' 2023-07-13T02:11:12.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.177 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-07-13T02:11:12.178 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-07-13T02:11:12.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4 2023-07-13T02:11:12.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.4.service' 2023-07-13T02:11:12.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.312 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-07-13T02:11:12.312 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-07-13T02:11:12.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5 2023-07-13T02:11:12.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.5.service' 2023-07-13T02:11:12.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.457 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-07-13T02:11:12.457 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-07-13T02:11:12.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6 2023-07-13T02:11:12.482 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.6.service' 2023-07-13T02:11:12.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.555 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-07-13T02:11:12.555 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-07-13T02:11:12.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7 2023-07-13T02:11:12.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.7.service' 2023-07-13T02:11:12.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.691 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-07-13T02:11:12.692 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-07-13T02:11:12.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8 2023-07-13T02:11:12.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.8.service' 2023-07-13T02:11:12.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.830 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-07-13T02:11:12.830 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-07-13T02:11:12.830 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9 2023-07-13T02:11:12.853 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.9.service' 2023-07-13T02:11:12.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:12.927 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-07-13T02:11:12.927 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-07-13T02:11:12.928 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10 2023-07-13T02:11:12.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.10.service' 2023-07-13T02:11:13.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:13.064 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-07-13T02:11:13.065 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-07-13T02:11:13.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11 2023-07-13T02:11:13.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.11.service' 2023-07-13T02:11:13.210 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:13.211 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-07-13T02:11:13.211 INFO:tasks.cephadm.osd.12:Stopping osd.12... 2023-07-13T02:11:13.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12 2023-07-13T02:11:13.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.12.service' 2023-07-13T02:11:13.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:13.310 INFO:tasks.cephadm.osd.12:Stopped osd.12 2023-07-13T02:11:13.311 INFO:tasks.cephadm.osd.13:Stopping osd.13... 2023-07-13T02:11:13.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13 2023-07-13T02:11:13.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.13.service' 2023-07-13T02:11:13.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:13.444 INFO:tasks.cephadm.osd.13:Stopped osd.13 2023-07-13T02:11:13.444 INFO:tasks.cephadm.osd.14:Stopping osd.14... 2023-07-13T02:11:13.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14 2023-07-13T02:11:13.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f81712b0-211c-11ee-9b31-001a4aab830c@osd.14.service' 2023-07-13T02:11:13.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-13T02:11:13.593 INFO:tasks.cephadm.osd.14:Stopped osd.14 2023-07-13T02:11:13.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force --keep-logs 2023-07-13T02:11:16.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force --keep-logs 2023-07-13T02:11:19.151 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force --keep-logs 2023-07-13T02:11:22.019 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force --keep-logs 2023-07-13T02:11:24.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force --keep-logs 2023-07-13T02:11:27.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:27.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:27.729 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:27.744 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:27.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-13T02:11:27.777 INFO:tasks.cephadm:Archiving crash dumps... 2023-07-13T02:11:27.780 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi022/crash 2023-07-13T02:11:27.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash -- . 2023-07-13T02:11:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-13T02:11:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2023-07-13T02:11:27.798 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi084/crash 2023-07-13T02:11:27.800 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash -- . 2023-07-13T02:11:27.815 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-13T02:11:27.815 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2023-07-13T02:11:27.817 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi103/crash 2023-07-13T02:11:27.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash -- . 2023-07-13T02:11:27.833 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-13T02:11:27.833 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2023-07-13T02:11:27.835 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi137/crash 2023-07-13T02:11:27.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash -- . 2023-07-13T02:11:27.852 INFO:teuthology.orchestra.run.smithi137.stderr:tar: /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-13T02:11:27.853 INFO:teuthology.orchestra.run.smithi137.stderr:tar: Error is not recoverable: exiting now 2023-07-13T02:11:27.854 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi154/crash 2023-07-13T02:11:27.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash -- . 2023-07-13T02:11:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-13T02:11:27.870 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2023-07-13T02:11:27.871 INFO:tasks.cephadm:Checking cluster log for badness... 2023-07-13T02:11:27.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-07-13T02:11:27.887 INFO:teuthology.orchestra.run.smithi022.stderr:grep: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph.log: No such file or directory 2023-07-13T02:11:27.889 INFO:tasks.cephadm:Compressing logs... 2023-07-13T02:11:27.890 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-13T02:11:27.933 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-13T02:11:27.936 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-13T02:11:27.938 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-13T02:11:27.941 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-13T02:11:27.946 INFO:teuthology.orchestra.run.smithi022.stderr:find: '/var/log/rbd-target-api': No such file or directory 2023-07-13T02:11:27.948 INFO:teuthology.orchestra.run.smithi084.stderr:find: '/var/log/rbd-target-api': No such file or directory 2023-07-13T02:11:27.953 INFO:teuthology.orchestra.run.smithi103.stderr:find: '/var/log/rbd-target-api': No such file or directory 2023-07-13T02:11:27.954 INFO:teuthology.orchestra.run.smithi137.stderr:find: '/var/log/rbd-target-api': No such file or directory 2023-07-13T02:11:27.957 INFO:teuthology.orchestra.run.smithi154.stderr:find: '/var/log/rbd-target-api': No such file or directory 2023-07-13T02:11:27.958 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.b.log 2023-07-13T02:11:27.959 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.5.log 2023-07-13T02:11:27.960 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.b.log 2023-07-13T02:11:27.960 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.5.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.4.log 2023-07-13T02:11:27.961 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.b.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.3.log 2023-07-13T02:11:27.961 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.4.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log 2023-07-13T02:11:27.962 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-13T02:11:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.a.log 2023-07-13T02:11:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.1.log 2023-07-13T02:11:27.965 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-13T02:11:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.a.log 2023-07-13T02:11:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.0.log 2023-07-13T02:11:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.1.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.a.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log 2023-07-13T02:11:27.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.2.log 2023-07-13T02:11:27.968 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-13T02:11:27.971 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.b.log.gz 2023-07-13T02:11:27.972 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.5.log.gz 2023-07-13T02:11:27.972 INFO:teuthology.orchestra.run.smithi084.stderr: 92.0% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log.gz 2023-07-13T02:11:27.977 INFO:teuthology.orchestra.run.smithi084.stderr: 94.8% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.4.log.gz 2023-07-13T02:11:27.977 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.3.log.gz 2023-07-13T02:11:27.978 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.e.log 2023-07-13T02:11:27.979 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.e.log 2023-07-13T02:11:27.979 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.e.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.14.log 2023-07-13T02:11:27.979 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.13.log 2023-07-13T02:11:27.979 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.e.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.12.log 2023-07-13T02:11:27.980 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log 2023-07-13T02:11:27.980 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-13T02:11:27.980 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.12.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log: /var/log/ceph/cephadm.log: 94.8% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.14.log.gz 2023-07-13T02:11:27.981 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-13T02:11:27.981 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log.gz 2023-07-13T02:11:27.982 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.e.log.gz 2023-07-13T02:11:27.983 INFO:teuthology.orchestra.run.smithi154.stderr: 94.7% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.12.log.gz 2023-07-13T02:11:27.983 INFO:teuthology.orchestra.run.smithi154.stderr: 94.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.13.log.gz 2023-07-13T02:11:27.983 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.2.log: /var/log/ceph/cephadm.log: 92.0% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log.gz 2023-07-13T02:11:27.983 INFO:teuthology.orchestra.run.smithi022.stderr: 93.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-13T02:11:27.984 INFO:teuthology.orchestra.run.smithi022.stderr: 94.7% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.0.log.gz 2023-07-13T02:11:27.984 INFO:teuthology.orchestra.run.smithi022.stderr: 94.8% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.1.log.gz 2023-07-13T02:11:27.984 INFO:teuthology.orchestra.run.smithi022.stderr: 95.0% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.2.log.gz 2023-07-13T02:11:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.c.log 2023-07-13T02:11:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.c.log 2023-07-13T02:11:27.984 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.c.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.6.log 2023-07-13T02:11:27.985 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.8.log 2023-07-13T02:11:27.985 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log 2023-07-13T02:11:27.985 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.6.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.7.log 2023-07-13T02:11:27.985 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-13T02:11:27.985 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.7.log: /var/log/ceph/cephadm.log: 94.8% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.8.log.gz 2023-07-13T02:11:27.986 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-13T02:11:27.986 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log.gz 2023-07-13T02:11:27.986 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.6.log.gz 2023-07-13T02:11:27.986 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.c.log.gz 2023-07-13T02:11:27.986 INFO:teuthology.orchestra.run.smithi103.stderr: 94.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.7.log.gz 2023-07-13T02:11:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.10.log 2023-07-13T02:11:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.d.log 2023-07-13T02:11:27.987 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.9.log 2023-07-13T02:11:27.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.11.log 2023-07-13T02:11:27.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.d.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log 2023-07-13T02:11:27.988 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.d.log 2023-07-13T02:11:27.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-13T02:11:27.988 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log: /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.d.log: /var/log/ceph/cephadm.log: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-13T02:11:27.988 INFO:teuthology.orchestra.run.smithi137.stderr: 94.7% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.9.log.gz 2023-07-13T02:11:27.989 INFO:teuthology.orchestra.run.smithi137.stderr: 92.0% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-volume.log.gz 2023-07-13T02:11:27.989 INFO:teuthology.orchestra.run.smithi137.stderr: 93.6% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.d.log.gz 2023-07-13T02:11:27.989 INFO:teuthology.orchestra.run.smithi137.stderr: 94.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.10.log.gz 2023-07-13T02:11:27.989 INFO:teuthology.orchestra.run.smithi137.stderr: 94.8% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-osd.11.log.gz 2023-07-13T02:11:28.172 INFO:teuthology.orchestra.run.smithi022.stderr: 91.9% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mgr.a.log.gz 2023-07-13T02:11:28.395 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.c.log.gz 2023-07-13T02:11:28.395 INFO:teuthology.orchestra.run.smithi103.stderr: 2023-07-13T02:11:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m0.454s 2023-07-13T02:11:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m0.481s 2023-07-13T02:11:28.396 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m0.032s 2023-07-13T02:11:28.404 INFO:teuthology.orchestra.run.smithi137.stderr: 93.7% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.d.log.gz 2023-07-13T02:11:28.405 INFO:teuthology.orchestra.run.smithi137.stderr: 2023-07-13T02:11:28.405 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m0.461s 2023-07-13T02:11:28.406 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m0.476s 2023-07-13T02:11:28.406 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.042s 2023-07-13T02:11:28.416 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.e.log.gz 2023-07-13T02:11:28.418 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-07-13T02:11:28.418 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m0.471s 2023-07-13T02:11:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m0.485s 2023-07-13T02:11:28.419 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.049s 2023-07-13T02:11:28.426 INFO:teuthology.orchestra.run.smithi084.stderr: 93.2% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.b.log.gz 2023-07-13T02:11:28.428 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-07-13T02:11:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m0.488s 2023-07-13T02:11:28.429 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m0.525s 2023-07-13T02:11:28.429 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.019s 2023-07-13T02:11:29.270 INFO:teuthology.orchestra.run.smithi022.stderr: 91.7% -- replaced with /var/log/ceph/f81712b0-211c-11ee-9b31-001a4aab830c/ceph-mon.a.log.gz 2023-07-13T02:11:29.271 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-07-13T02:11:29.271 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m1.335s 2023-07-13T02:11:29.272 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m1.540s 2023-07-13T02:11:29.272 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m0.062s 2023-07-13T02:11:29.273 INFO:tasks.cephadm:Archiving logs... 2023-07-13T02:11:29.273 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi022/log 2023-07-13T02:11:29.274 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T02:11:29.564 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi084/log 2023-07-13T02:11:29.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T02:11:29.658 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi103/log 2023-07-13T02:11:29.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T02:11:29.735 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi137/log 2023-07-13T02:11:29.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T02:11:29.809 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi154/log 2023-07-13T02:11:29.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-13T02:11:29.910 INFO:tasks.cephadm:Removing cluster... 2023-07-13T02:11:29.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force 2023-07-13T02:11:31.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force 2023-07-13T02:11:32.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force 2023-07-13T02:11:34.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force 2023-07-13T02:11:35.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f81712b0-211c-11ee-9b31-001a4aab830c --force 2023-07-13T02:11:37.443 INFO:tasks.cephadm:Removing cephadm ... 2023-07-13T02:11:37.444 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-13T02:11:37.451 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-13T02:11:37.459 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-13T02:11:37.466 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-13T02:11:37.473 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-13T02:11:37.480 INFO:tasks.cephadm:Teardown complete 2023-07-13T02:11:37.481 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 1643, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 1558, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 894, in ceph_osds while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (121) after waiting for 120 seconds 2023-07-13T02:11:37.558 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cde3e75cff1f43b2be3d222300a1672c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 1643, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 1558, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_3990f91ac125621431ef1b77c2fc96421bec9e51/qa/tasks/cephadm.py", line 894, in ceph_osds while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (121) after waiting for 120 seconds 2023-07-13T02:11:37.562 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-07-13T02:11:37.571 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-13T02:11:37.586 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-13T02:11:37.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T02:11:37.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T02:11:37.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T02:11:37.606 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T02:11:37.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-13T02:11:37.763 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-13T02:11:37.776 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-13T02:11:37.776 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T02:11:37.779 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T02:11:37.781 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T02:11:37.784 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T02:11:37.787 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-13T02:11:37.795 INFO:teuthology.orchestra.run.smithi022.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T02:11:37.796 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================== 2023-07-13T02:11:37.796 INFO:teuthology.orchestra.run.smithi022.stdout:*hv01.front.sepi 44.4.53.2 2 u 19 64 377 0.093 2.531 2.341 2023-07-13T02:11:37.796 INFO:teuthology.orchestra.run.smithi022.stdout:+hv02.front.sepi 63.231.80.2 3 u 24 64 377 0.094 2.082 1.266 2023-07-13T02:11:37.797 INFO:teuthology.orchestra.run.smithi022.stdout:+hv03.front.sepi 74.6.168.72 3 u 17 64 377 0.098 3.571 1.429 2023-07-13T02:11:37.797 INFO:teuthology.orchestra.run.smithi022.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-07-13T02:11:37.799 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T02:11:37.799 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2023-07-13T02:11:37.799 INFO:teuthology.orchestra.run.smithi084.stdout:*hv01.front.sepi 44.4.53.2 2 u 83 128 377 0.104 0.097 0.624 2023-07-13T02:11:37.800 INFO:teuthology.orchestra.run.smithi084.stdout:+hv02.front.sepi 63.231.80.2 3 u 21 128 377 0.104 1.688 0.356 2023-07-13T02:11:37.800 INFO:teuthology.orchestra.run.smithi084.stdout:+hv03.front.sepi 74.6.168.72 3 u 82 128 377 0.093 2.078 0.567 2023-07-13T02:11:37.800 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-07-13T02:11:37.802 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T02:11:37.802 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2023-07-13T02:11:37.803 INFO:teuthology.orchestra.run.smithi103.stdout:*hv01.front.sepi 44.4.53.2 2 u 88 128 377 0.104 -0.254 0.417 2023-07-13T02:11:37.803 INFO:teuthology.orchestra.run.smithi103.stdout:+hv02.front.sepi 63.231.80.2 3 u 80 128 377 0.129 1.724 0.290 2023-07-13T02:11:37.803 INFO:teuthology.orchestra.run.smithi103.stdout:+hv03.front.sepi 74.6.168.72 3 u 77 128 377 0.087 1.793 0.438 2023-07-13T02:11:37.804 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-07-13T02:11:37.805 INFO:teuthology.orchestra.run.smithi137.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T02:11:37.806 INFO:teuthology.orchestra.run.smithi137.stdout:============================================================================== 2023-07-13T02:11:37.806 INFO:teuthology.orchestra.run.smithi137.stdout:*hv01.front.sepi 44.4.53.2 2 u 30 64 377 0.108 -0.398 0.115 2023-07-13T02:11:37.806 INFO:teuthology.orchestra.run.smithi137.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.091 1.877 0.139 2023-07-13T02:11:37.806 INFO:teuthology.orchestra.run.smithi137.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.101 1.526 0.167 2023-07-13T02:11:37.806 INFO:teuthology.orchestra.run.smithi137.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-07-13T02:11:37.807 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2023-07-13T02:11:37.807 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2023-07-13T02:11:37.808 INFO:teuthology.orchestra.run.smithi154.stdout:*hv01.front.sepi 44.4.53.2 2 u 74 128 377 0.110 -2.944 0.111 2023-07-13T02:11:37.808 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 128 377 0.093 -0.974 0.287 2023-07-13T02:11:37.808 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 128 377 0.094 -1.183 0.272 2023-07-13T02:11:37.808 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-07-13T02:11:37.809 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-13T02:11:37.823 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-13T02:11:37.824 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-13T02:11:37.834 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-13T02:11:37.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-13T02:11:37.864 INFO:teuthology.task.internal:Duration was 2955.675615 seconds 2023-07-13T02:11:37.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-13T02:11:37.875 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-13T02:11:37.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T02:11:37.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T02:11:37.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T02:11:37.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T02:11:37.885 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-13T02:11:37.933 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-13T02:11:37.933 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2023-07-13T02:11:37.934 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T02:11:37.949 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-07-13T02:11:37.949 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T02:11:37.985 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2023-07-13T02:11:37.986 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T02:11:38.002 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2023-07-13T02:11:38.003 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T02:11:38.017 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2023-07-13T02:11:38.018 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-13T02:11:38.034 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-13T02:11:38.035 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T02:11:38.037 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T02:11:38.042 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T02:11:38.047 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T02:11:38.063 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-13T02:11:38.120 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-13T02:11:38.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T02:11:38.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T02:11:38.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T02:11:38.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T02:11:38.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-13T02:11:38.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-13T02:11:38.272 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-13T02:11:38.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T02:11:38.289 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T02:11:38.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T02:11:38.321 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T02:11:38.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-13T02:11:38.355 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-13T02:11:38.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.372 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.381 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2023-07-13T02:11:38.384 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-07-13T02:11:38.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.388 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2023-07-13T02:11:38.400 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2023-07-13T02:11:38.412 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2023-07-13T02:11:38.436 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T02:11:38.458 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T02:11:38.464 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T02:11:38.470 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T02:11:38.479 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-13T02:11:38.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-13T02:11:38.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-13T02:11:38.496 INFO:teuthology.task.internal:Transferring archived files... 2023-07-13T02:11:38.497 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi022 2023-07-13T02:11:38.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T02:11:38.528 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi084 2023-07-13T02:11:38.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T02:11:38.554 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi103 2023-07-13T02:11:38.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T02:11:38.579 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi137 2023-07-13T02:11:38.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T02:11:38.605 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580/remote/smithi154 2023-07-13T02:11:38.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-13T02:11:38.631 INFO:teuthology.task.internal:Removing archive directory... 2023-07-13T02:11:38.631 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-13T02:11:38.634 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-13T02:11:38.636 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-13T02:11:38.638 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-13T02:11:38.647 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-13T02:11:38.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-13T02:11:38.691 INFO:teuthology.task.internal:Not uploading archives. 2023-07-13T02:11:38.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-13T02:11:38.706 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-13T02:11:38.707 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T02:11:38.709 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T02:11:38.711 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T02:11:38.713 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T02:11:38.715 INFO:teuthology.orchestra.run.smithi022.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 02:11 /home/ubuntu/cephtest 2023-07-13T02:11:38.716 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-13T02:11:38.717 INFO:teuthology.orchestra.run.smithi084.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 02:11 /home/ubuntu/cephtest 2023-07-13T02:11:38.720 INFO:teuthology.orchestra.run.smithi103.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 02:11 /home/ubuntu/cephtest 2023-07-13T02:11:38.722 INFO:teuthology.orchestra.run.smithi137.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 02:11 /home/ubuntu/cephtest 2023-07-13T02:11:38.726 INFO:teuthology.orchestra.run.smithi154.stdout: 1048617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 13 02:11 /home/ubuntu/cephtest 2023-07-13T02:11:38.729 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-13T02:11:38.741 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-13T02:11:38.772 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T02:11:38.801 DEBUG:teuthology.nuke:shortname: smithi022 2023-07-13T02:11:38.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:11:38.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.270766', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-13T02:11:38.831 DEBUG:teuthology.nuke:shortname: smithi084 2023-07-13T02:11:38.831 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:11:38.855 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.277151', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-13T02:11:38.862 DEBUG:teuthology.nuke:shortname: smithi103 2023-07-13T02:11:38.862 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:11:38.885 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.274313', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-13T02:11:38.896 INFO:teuthology.orchestra.console:Power off smithi022 2023-07-13T02:11:38.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:11:38.907 DEBUG:teuthology.nuke:shortname: smithi137 2023-07-13T02:11:38.908 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:11:38.918 INFO:teuthology.orchestra.console:Power off smithi084 2023-07-13T02:11:38.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:11:38.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:38.948 DEBUG:teuthology.nuke:shortname: smithi154 2023-07-13T02:11:38.949 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:11:38.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:38.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.272691', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-13T02:11:38.993 INFO:teuthology.orchestra.console:Power off smithi103 2023-07-13T02:11:38.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:11:39.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335580', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:12:26.275875', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-13T02:11:39.018 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:39.047 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-13T02:11:39.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:11:39.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:39.092 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-13T02:11:39.093 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:11:39.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:42.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:42.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:43.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:43.107 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:43.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:47.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:47.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:47.175 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:47.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:47.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:47.302 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2023-07-13T02:11:47.312 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-07-13T02:11:47.388 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2023-07-13T02:11:47.479 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-13T02:11:51.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:11:51.550 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-13T02:11:51.655 INFO:teuthology.run:Summary data: description: orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} duration: 2955.675615310669 failure_reason: reached maximum tries (121) after waiting for 120 seconds flavor: default owner: scheduled_gabrioux@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cde3e75cff1f43b2be3d222300a1672c status: fail success: false 2023-07-13T02:11:51.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:11:51.742 INFO:teuthology.run:FAIL